Member of Technical Staff - Index Engineer, Search Crawler
Perplexity · Belgrade
Description du poste
About the role
Perplexity is looking for an engineer to work on the indexing and data processing layer of its Search Crawler. You will build systems that ingest, process and organise large volumes of crawled content into efficient, queryable structures, mainly on offline and nearline pipelines that keep data fresh, complete and accessible to downstream retrieval. Throughput, scalability and correctness are critical across datasets that change continuously.
Key responsibilities
- Design, implement and operate large-scale indexing systems and data pipelines at the core of the search infrastructure.
- Develop and optimise indexing strategies that balance performance, freshness and resource efficiency.
- Work on storage formats, compaction and update mechanisms that keep data accessible and current.
- Keep pipelines reliable and predictable under high-throughput conditions, with well-tested components and clear interfaces.
- Define observability across offline and nearline pipelines, including structured logs, metrics and data quality signals.
- Monitor throughput, resource usage and cost, and drive optimisation as business needs change.
- Partner with retrieval, ranking and ML teams so indexing outputs meet their requirements.
- Enable safe experimentation on indexing strategies and processing logic through controlled rollouts and quality signals.
Required profile
- 5+ years of experience building production backend or data infrastructure systems.
- Experience with high-throughput data processing systems and very large datasets.
- Experience building or operating databases, storage systems, data planes or indexing pipelines.
- Strong understanding of distributed systems, fault tolerance, consistency and scalability.
- Experience running production systems and handling operational incidents.
- A systems-thinking mindset and the ability to reason about end-to-end data flows.
Required skills
- Strong programming in Go, C++ or Rust.
- Experience with databases, storage systems, data planes or indexing pipelines.
Questions fréquentes
Pourquoi signalez-vous cette offre ?
Aller plus loin
Salaires, guides et recherches en Serbie.
Salaires par métier
Postulez en 30 secondes
Entrez votre email pour postuler. Un compte sera cree automatiquement.
En continuant, vous acceptez nos conditions d'utilisation.
Deja un compte ? Connexion
Une question sur cette offre ?
Posez-la ici : vous recevrez le récapitulatif de l'offre par e-mail, tout de suite.
Publie il y a 7 heures
Expire dans 1 mois
4 vues · 0 interesses
Boostez vos chances
Importez votre CV : nous vous proposons les offres qui matchent votre profil.
Analyse de votre CV en cours...
Perplexity
Belgrade
Offres similaires
-
Software Engineer - Database Engine Internals
Databricks Belgrade -
Senior Software Engineer - Database Engine Internals
Databricks Belgrade -
Senior RTL Design Engineer, AI Hardware
Tenstorrent Belgrade -
Senior SAP Consultant - S/4HANA P2F
EPAM Systems -
Lead SAP Consultant - Plan-to-Fulfill (SAP S/4HANA Private Cloud)
EPAM Systems