DevOps Engineer – AI Inference

Gcore

New Remote

Remote 🇬🇧 English

Kubernetes CNI CSI operators ingress gateway Linux DNS routing firewalling TLS MTU Python Go Bash Terraform Ansible VictoriaMetrics Grafana Git CI/CD pipelines Argo CD GitOps Helm Helmfile Slurm NVIDIA GPU stack RDMA InfiniBand OpenStack

Job description

About the role

Gcore is looking for a DevOps Engineer to join its AI Inference Operations Team. You will design, deploy and maintain the infrastructure that powers scalable and secure AI inference workloads on‑premises, working with cutting‑edge GPU and networking technologies.

Key responsibilities

Design, develop and maintain on‑prem infrastructure for AI inference, including GPU scheduling, model deployment pipelines and data access patterns.
Build and operate monitoring and observability tools (dashboards, alerts, runbooks) to ensure model health and system performance.
Collaborate with ML engineers and platform teams to define system architecture, integrate inference runtimes and test performance at scale.

Required profile

Strong understanding of Kubernetes architecture (CNI, CSI, operators, ingress/gateway, control‑plane components).
Hands‑on experience operating and troubleshooting production Kubernetes clusters.
Deep Linux and networking troubleshooting skills (DNS, routing, firewalling, TLS, MTU, connectivity).
Ability to develop automation tooling using Python, Go or Bash.

Required skills

Kubernetes, Terraform, Ansible
Python, Go, Bash
VictoriaMetrics, Grafana
Git‑based workflows, CI/CD pipelines
Argo CD, Helm, Helmfile

What we offer

Competitive compensation
Flexible working hours with hybrid or remote options
Ability to work from anywhere up to 45 days per year
Private medical insurance for you and your family
Extra paid vacation and sick leave days
Language courses, modern offices with snacks and entertainment, team sports and social activities

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec Gcore.

Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.

Why are you reporting this job?

Thank you for your report. We will review this job.

Explore further

Salaries, guides and searches in Serbia.

Salary: Senior DevOps Engineer Based on 9 job offers in Serbia

Salaries by job title

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

A question about this job?

Ask it here: you will get the full job summary by e-mail, right away.

💬 Chat with us on Telegram

Published 1 day ago

Expires 1 month from now

4 views · 0 interested

Share Log in to earn credits by sharing

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...