Jobiglo

No results.

Member of Technical Staff - Index Engineer, Search Crawler

Perplexity · Belgrade

New
Senior 🇬🇧 English
Go C++ Rust Distributed systems Data pipelines

Job description

About the role

Perplexity is looking for an engineer to work on the indexing and data processing layer of its Search Crawler. You will build systems that ingest, process and organise large volumes of crawled content into efficient, queryable structures, mainly on offline and nearline pipelines that keep data fresh, complete and accessible to downstream retrieval. Throughput, scalability and correctness are critical across datasets that change continuously.

Key responsibilities

  • Design, implement and operate large-scale indexing systems and data pipelines at the core of the search infrastructure.
  • Develop and optimise indexing strategies that balance performance, freshness and resource efficiency.
  • Work on storage formats, compaction and update mechanisms that keep data accessible and current.
  • Keep pipelines reliable and predictable under high-throughput conditions, with well-tested components and clear interfaces.
  • Define observability across offline and nearline pipelines, including structured logs, metrics and data quality signals.
  • Monitor throughput, resource usage and cost, and drive optimisation as business needs change.
  • Partner with retrieval, ranking and ML teams so indexing outputs meet their requirements.
  • Enable safe experimentation on indexing strategies and processing logic through controlled rollouts and quality signals.

Required profile

  • 5+ years of experience building production backend or data infrastructure systems.
  • Experience with high-throughput data processing systems and very large datasets.
  • Experience building or operating databases, storage systems, data planes or indexing pipelines.
  • Strong understanding of distributed systems, fault tolerance, consistency and scalability.
  • Experience running production systems and handling operational incidents.
  • A systems-thinking mindset and the ability to reason about end-to-end data flows.

Required skills

  • Strong programming in Go, C++ or Rust.
  • Experience with databases, storage systems, data planes or indexing pipelines.

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec Perplexity.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.

Why are you reporting this job?

Thank you for your report. We will review this job.

Explore further

Salaries, guides and searches in Serbia.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

A question about this job?

Ask it here: you will get the full job summary by e-mail, right away.

Published 7 hours ago

Expires 1 month from now

3 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

Perplexity

Belgrade