Software Engineering Manager Siri Evaluation, Test Development Tooling

Siris quality signal drives every model and product decision before a release ships and that signal is only as good as the tests and scenarios behind it. The Test Development Tooling team part of the Siris Agentic Evaluation Engineering organization is reimagining how those scenarios are created and maintained. We build tools and AI-powered automation that free our engineers to focus on the quality and strategy of evaluation rather than the manual work of authoring tests. Were looking for an inspiring hands-on engineering leader to run this team and set its technical direction.

The ideal candidate is technically strong player-coach that will provide technical direction for the team. Responsibilities include leading a team of high-performing engineers setting technical direction driving development from requirements to delivery collaborating with partner teams across Apple and mentoring engineers to reach their best potential.

Lead and grow a team of engineers building AI agent-based scenario authoring and selection the teams technical direction and the systems that generate validate ground and manage evaluation scenarios through their full coverage traceability and gap analysis so that every product capability maps to a scenario and every gap is and evolve coverage reliability and health dashboards and release-readiness signals that leadership relies on for ship across the evaluation organization and Apple to integrate and ground scenarios end to end at with QE engineers feature teams architecture leads and design stakeholders to set and hold a defensible quality mentor and develop engineers including senior ICs with a focus on engineering rigor technical depth and clear effectively in ambiguity reshaping team scope as the evaluation platform and the underlying Siri architecture evolve.

5 years of experience developing production software (e.g. Swift Python Java or Go).n3 years of engineering management technical leadership and the ability to set architectural direction and inspire a with test infrastructure CI/CD or evaluation/ML and self-motivated with demonstrated creative and critical-thinking abilities.

Experience building or leading teams that apply LLMs / AI agents to real engineering workflows (e.g. automated test generation code generation or agentic pipelines with human-in-the-loop review).nDepth in one or more of: distributed systems and backend services (REST/gRPC) cloud infrastructure (Docker/Kubernetes) data platforms or large-scale test and release with Apples testing frameworks (XCTest and related) and with ML/LLM evaluation cross-functional leadership and the ability to drive coverage and quality decisions with senior hiring and growing a team including senior spoken and written communication operating in ambiguity and reshaping team scope as the domain matures.