Enter a job title or keyword
Sr. Machine Learning Engineer, ML Systems Evaluation Engineering
Job Location:
Job Location:
Cupertino, CA - USA
Monthly Salary:
Not provided by the employer
Monthly Salary:
Posted:
13 September 2026 (3 hours ago)
Posted:
Application Deadline:
11 December 2026
Application Deadline:
Vacancies:
1 Vacancy
Vacancies:
Job Summary
Join the team redefining what a deeply personal and integrated assistant can part of the Siri organization you will help shape one of the worlds most widely used AI assistants powered by our next-generation of Apple Intelligence with capabilities like personal context understanding and on-screen awareness built with privacy from the ground up. Your work will have direct meaningful impact for users across iOS iPadOS macOS watchOS and is a rare opportunity to build at the intersection of cutting-edge AI and human-centered design shipping technology that is centered around users and their the SCALE (Statistical Coverage and Large-scale Evaluation) team at Apple and contribute to a highly accomplished group that evaluates Siri and AI/ML models at scale to delight and inspire our users globally. If you are excited by large-scale systems rigorous statistical evaluation natural language understanding and shaping the future of AI we want you here! Youll do more than join something youll add something!
We are seeking a highly skilled Senior Machine Learning Engineer specializing in Conversational AI. Our goal is to deliver offline evaluation insights that drive model development and improve the end-user experience all while upholding Apples strict privacy this pivotal role you will collaborate with cross-functional teams to curate and evolve high-quality evaluation datasets for state-of-the-art models. With the advent of Apple Intelligence you will tackle novel challenges in evaluating highly personalized user experiences.
Your key focus will be leveraging Large Language Models (LLMs) to automatically evaluate model changes (LLM-as-a-Judge) and assess the naturalness of digital assistant conversations. nYou will also harness generative AI to create adversarial scenarios that anticipate edge cases enabling robust forward-looking evaluation. nYour work and the datasets you generate will directly shape the next generation of Siri and Apple products.
7 years of professional experience applying machine learning to real-world problems and crafting scalable data solutions specifically in natural language experience managing large-scale datasets for ML training and/or programming skills in PythonnMS/PhD in Machine Learning Computer Science or equivalent experience in a related field
The qualifications that will benefit a candidate to be successful in your role. Please list no more than domain knowledge in Conversational AI and a strong understanding of the end-to-end ML product in defining and measuring evaluation coverage for Large Language Models (LLMs) and agentic record of delivering large-scale cross-functional ML product or platform problem-solving critical thinking and communication skills to drive alignment across with systems engineering; in-depth understanding of interdependencies of ML and SW components
We are seeking a highly skilled Senior Machine Learning Engineer specializing in Conversational AI. Our goal is to deliver offline evaluation insights that drive model development and improve the end-user experience all while upholding Apples strict privacy this pivotal role you will collaborate with cross-functional teams to curate and evolve high-quality evaluation datasets for state-of-the-art models. With the advent of Apple Intelligence you will tackle novel challenges in evaluating highly personalized user experiences.
Your key focus will be leveraging Large Language Models (LLMs) to automatically evaluate model changes (LLM-as-a-Judge) and assess the naturalness of digital assistant conversations. nYou will also harness generative AI to create adversarial scenarios that anticipate edge cases enabling robust forward-looking evaluation. nYour work and the datasets you generate will directly shape the next generation of Siri and Apple products.
7 years of professional experience applying machine learning to real-world problems and crafting scalable data solutions specifically in natural language experience managing large-scale datasets for ML training and/or programming skills in PythonnMS/PhD in Machine Learning Computer Science or equivalent experience in a related field
The qualifications that will benefit a candidate to be successful in your role. Please list no more than domain knowledge in Conversational AI and a strong understanding of the end-to-end ML product in defining and measuring evaluation coverage for Large Language Models (LLMs) and agentic record of delivering large-scale cross-functional ML product or platform problem-solving critical thinking and communication skills to drive alignment across with systems engineering; in-depth understanding of interdependencies of ML and SW components
Required Experience:
Senior IC
About Company
Ask Siri to name the most successful company in the world and it might respond: Apple. And it's not just out of familial pride. Apple consistently ranks highly in profit, revenue, market capitalization, and consumer cachet. In 2018, the company became the first reach a trillion dollar ... View more
