Member of Technical Staff (Search Core, Indexing & Data Pipeline Stream)

About the role

Perplexity is looking for a highly skilled Expert Systems Engineer to join our Search Core team, focusing on indexing and data processing streams. This role is critical to building next‑generation search products and technologies.

Key responsibilities

• Design and build core search engine components, especially indexing pipelines and data storage formats that operate at the scale of billions of pages.
• Develop streaming and batch data processing systems for search index construction in high‑load environments.
• Push the limits of hardware performance through low‑level optimizations and systems‑level tuning.
• Tackle challenges in multithreading, concurrency, and system‑level optimization.

Required profile

• 3+ years of hands‑on experience in systems programming using Rust, C++, C or similar languages.
• Ownership of the full project lifecycle, from fast inner‑loop development to deployment, operation, and scaling in production.
• Knowledge of Python or other scripting languages.
• Familiarity with data processing systems such as YT, Kafka, and Hadoop.
• Strong knowledge of algorithms and data structures and the ability to apply them effectively.
• Deep understanding of multithreading, concurrency, and related trade‑offs.
• Experience building high‑load, distributed, and hardware‑adjacent services.
• Solid understanding of Linux internals, including syscalls, networking stack, memory model, and kernel tuning.

Required skills

• Rust
• C++
• C
• Python
• YT
• Kafka
• Hadoop
• Linux
• Kubernetes
• AWS