This job is no longer available
This job expired on 26/10/2026. It no longer accepts applications.
DevOps Engineer – AI Inference
Gcore
Job description
About the role
Gcore is looking for a DevOps Engineer to join its AI Inference Operations Team. You will design, deploy and maintain the infrastructure that powers scalable and secure AI inference workloads on‑premises, working with cutting‑edge GPU and HPC technologies.
Key responsibilities
- Design, develop and maintain infrastructure for AI inference, including GPU scheduling, model deployment pipelines and data access patterns.
- Build and operate monitoring and observability solutions (dashboards, alerts, runbooks) for model health and system performance.
- Collaborate with ML engineers and platform teams to define system architecture, integrate inference runtimes and test performance at scale.
Required profile
- Strong understanding of Kubernetes architecture (CNI, CSI, operators, ingress/gateway, control‑plane components).
- Hands‑on experience operating and troubleshooting production Kubernetes clusters.
- Deep Linux and networking troubleshooting skills (DNS, routing, firewalling, TLS, MTU, connectivity).
- Ability to develop automation and operational tooling using Python, Go or Bash.
- Experience with infrastructure‑as‑code tools such as Terraform or Ansible.
- Familiarity with monitoring stacks like VictoriaMetrics and Grafana.
- Proficiency with Git‑based workflows and CI/CD pipelines.
Required skills
- Kubernetes
- Linux
- Python
- Go
- Bash
- Terraform
- Ansible
- VictoriaMetrics
- Grafana
- Git
- CI/CD pipelines
- CNI, CSI, operators, ingress, gateway, control‑plane
- DNS, routing, firewalling, TLS, MTU
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Serbia.
Salary: Senior DevOps Engineer Based on 14 job offers in SerbiaSalaries by job title
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Gcore