Posted 2 d ago
Member of Technical Staff (Index, Search Crawler)
·London, United Kingdom · Belgrade, Serbia · Dublin, Ireland·via Ashby
Posted by Perplexity on 17 November 2026, 2 days ago. Still on their Ashby board when we checked 18 min ago. Half of Perplexity's roles come down within 62 days.
mid5+ yrsFull time
What the posting is about
Design and implement large-scale indexing systems for Perplexity's search infrastructure. Balance performance, freshness, and resource efficiency. Collaborate with retrieval, ranking, and ML teams to ensure indexing outputs meet their requirements.
Your experience, ready for this role
Answer a few questions about your real work. Review the additions and download your CV.
Read out of the posting
Levelmid
Experience asked5+ years
EmploymentFull time
LocationLondon, United Kingdom, Belgrade, Serbia, Dublin, Ireland
Work arrangementNot stated
Visa sponsorshipNot stated
SalaryNot extracted, check the posting
Posted2026-11-17
Found viaashby, direct from their system
We had it within the hour it went up.
The posting, as the company wrote it
AI answers are only as trustworthy as the information behind them. Perplexity grounds its answers in fresh, real-world sources, and the index is what makes that possible. We're looking for an engineer to work on the indexing and data processing layer of Perplexity's Search Crawler. You'll build systems that ingest, process, and organize large volumes of crawled content into efficient, queryable structures, working primarily on offline and nearline pipelines that keep data fresh, complete, and accessible to downstream retrieval. Throughput, scalability, and correctness are critical across datasets that change continuously.
Responsibilities
- Design, implement, and operate large-scale indexing systems and data pipelines at the core of Perplexity's search infrastructure.
- Develop and optimize indexing strategies that balance performance, freshness, and resource efficiency.
- Work on storage formats, compaction, and update mechanisms that keep data accessible and current.
- Keep pipelines reliable and predictable under high-throughput conditions.
- Build well-tested components with clear responsibilities and interface contracts that stay flexible as the system evolves.
- Define and implement observability across offline and near line pipelines, including structured logs, metrics, and data quality signals.
- Monitor throughput, resource usage, and cost, and drive optimisations as business needs change.
- Partner with retrieval, ranking, and ML teams to make sure indexing outputs meet their requirements.
- Enable safe experimentation on indexing strategies and processing logic through controlled rollouts and clearly defined quality signals.
Qualifications
- 5+ years of experience building production backend or data infrastructure systems.
- Strong programming experience in Go, C++, or Rust.
- Experience with high-throughput data processing systems and very large datasets.
- Experience building or operating databases, storage systems, data planes, or indexing pipelines.
- Strong understanding of distributed systems, fault tolerance, consistency, and scalability.
- Experience running production systems and handling operational incidents.
- A systems-thinking mindset and the ability to reason about end-to-end data flows.
Copied from Perplexity’s own board, not rewritten.
Why this page exists
We read companies’ own hiring systems every hour, 2,106 of them, and show a job the hour it opens instead of when a job board gets around to indexing it. We had it within the hour it went up.
The feed is free. No card, no trial to expire.
A free account and your résumé first, no card