Senior Software Engineer - AI Systems Performance

About the role

A leading semiconductor and high-performance computing company is looking for a Senior Software Engineer focused on distributed AI inference on GPUs and on improving the performance of key applications and benchmarks. The role is remote and based in Serbia, within a core team of industry specialists working with the latest hardware and software.

Key responsibilities

• Enable and benchmark AI models on large-scale distributed systems to evaluate performance, accuracy and scalability.
• Optimize AI workloads across scale-up (multi-GPU), scale-out (multi-node) and scale-across configurations.
• Work with internal GPU library teams to analyze and optimize distributed workloads for high throughput and low latency.
• Develop and apply parallelization strategies for AI workloads.
• Contribute to distributed model management systems, model zoos, monitoring frameworks, benchmarking pipelines and technical documentation.
• Build and maintain real-time dashboards reporting performance, accuracy and reliability metrics.

Required profile

• Strong C++ and Python development skills, with experience solving performance issues and investigating scalability on multi-GPU, multi-node clusters.
• Passion for quality assurance, benchmarking and automation in the AI/ML space.
• Thrives in both collaborative and independent environments, with strong problem-solving skills and ownership of goals and results.

Required skills

• PREFERRED: hands-on experience with AI inference or serving frameworks such as vLLM, SGLang and Llama.cpp.
• Understanding of KV cache transfer mechanisms (e.g. Mooncake, NIXL/RIXL) and expert parallelization (e.g. DeepEP, MORI, PPLX-Garden).
• Experience running AI workloads on large-scale, heterogeneous compute clusters.
• Familiarity with cluster management and orchestration platforms such as SLURM and Kubernetes.
• Experience with GitHub, Jenkins or similar CI/CD tools.
• Nice to have: a Master's or PhD in Computer Science or a related field, or equivalent practical experience; English at C1 Advanced level.