Engineering Manager, Web Indexing

Were looking for an Engineering Manager to lead the team that builds and scales the indexing infrastructure powering web and image search. The team runs both petabyte-scale offline batch pipelines and near-real-time indexing systems that turn web documents images and metadata into production-ready lead engineers across distributed computing data processing and storage while partnering with crawling ranking ML retrieval and infrastructure teams to shape the long-term indexing strategy. This is a cross-functional leadership role requiring strong technical depth organizational influence and the ability to drive complex multi-team initiatives.

Youll own both technical direction and execution for two core systems: large-scale offline indexing (distributed pipelines processing petabytes of content into production indexes) and fresh/near-real-time indexing (low-latency propagation of new or updated content). Responsibilities span architecture scalability reliability and efficiency across billions of documents and requires close collaboration across teams to resolve dependencies make architecture tradeoffs and drive large programs to completion while acting as a key liaison to senior leadership on strategy risks and resourcing.

Lead and grow a team building large-scale web and image indexing infrastructurenOwn architecture and execution for both offline batch pipelines and near-real-time indexing systemsnDrive improvements in freshness throughput scalability reliability and efficiencynEnable rapid experimentation for search quality and ML teams introducing new signalsnBuild strong cross-team partnerships (crawling ranking ML storage serving) and align on architecture and delivery milestonesnRepresent the indexing org in leadership reviews communicating strategy progress and tradeoffsnRecruit and develop engineers fostering a culture of ownership and technical excellence

Significant experience building large-scale distributed systems or data infrastructurenEngineering management experience leading software teamsnStrong grasp of distributed systems large-scale data processing and storagenExperience with distributed batch processing (e.g. MapReduce-style models)nTrack record leading multi-team technical initiatives and influencing without direct authoritynStrong communication skills for technical topics with senior leadershipnBS in CS or related field or equivalent experience

Experience with batch/streaming frameworks (Spark Beam Flink Kafka etc.)nExperience with distributed storage systems (Bigtable HBase Cassandra)nBackground in search information retrieval or large-scale content processingnExperience with image processing computer vision or multimodal systemsnExperience optimizing distributed systems for cost latency and throughputnExperience driving cross-org programs and presenting strategy to executive leadershipnTrack record developing senior engineers into technical leadership roles