Principal Product Manager M365 Copilot LLM Platform
Job Location:
Redmond, WA - USA
Yearly Salary:
Posted:
Application Deadline:
Vacancies:
Department:
Job Summary
The Microsoft 365 Core Copilot Infrastructure team is hiring a Principal Product Manager to be the product owner and architect for the M365 LLM platform that powers Copilot across Microsoft 365. This is not a capacity operations role. We are looking for a technical product leader who can think through the platform end to end: which hardware SKUs we bet on how we manage and allocate the GPU and CPU fleet and which optimizations we make at each layer of the stack and who can turn that thinking into products roadmaps and decisions.
AI growth is reshaping the platform. Demand is larger and less predictable than ever hardware and model choices carry more weight and the cost of getting them wrong scales with the fleet. You will set the direction for the platform and build intelligent self-service systems to replace manual ticket-driven processes. Building agents to optimize outcomes using live constraints availability and demand always anchored in what our Copilot customers and partner teams need.
This is an AI-first product management role. You will use agents automation and AI-driven analysis alongside standard PM tools to read telemetry model tradeoffs prototype solutions and reach decisions faster. You will translate hard technical and financial tradeoffs into terms leaders can act on and you will lead the team toward AI-forward ways of working including evaluation sets and agent-based workflows built into how the work gets done.
You will partner closely with engineering leaders architects data scientists finance supply chain and Copilot scenario teams across Microsoft. The role carries broad visibility and influence and it depends on strong product sense technical depth data fluency a customer- and partner-facing mindset and clear judgment under uncertainty. As a senior leader on the team you will operate independently act as a true partner to the teams leadership mentor other product managers and raise the bar for how the team works.
This position is based in Redmond Washington and requires the employee be in the office a minimum of 3 days per week.
Microsofts mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect integrity and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
- Own the product vision strategy and roadmap for the infrastructure layer of the M365 LLM platform and turn that direction into plans engineering teams can execute.
- Act as a platform architect: reason end to end across hardware SKU selection fleet management and allocation model serving and optimization opportunities and drive consistent decisions across all of them.
- Lead the product direction for AI-driven decision systems: agents and automation that recommend how to place allocate and transition GPU and CPU capacity based on live constraints availability and demand.
- Replace manual ticket-driven intake and allocation with intelligent self-service platform capabilities and measure their adoption and impact.
- Bring a strong customer and partner mindsetpartner with Copilot scenario teams and platform partners to understand their needs and translate them into durable platform capabilities and investments.
- Identify and prioritize efficiency and performance optimizations across hardware serving and models weighing cost performance and reliability with partners across engineering finance and supply chain.
- Advance platform model and hardware transition strategy including bringing new hardware generations and models onto the platform.
Qualifications
- Bachelors Degree AND 8 years experience in product/service/program management or software development
- OR equivalent experience.
- Bachelors Degree AND 12 years experience in product/service/program management or software development
- OR equivalent experience.
- 4 years experience taking a product feature or experience to market (e.g. design addressing product market fit and launch internal tool/framework).
- 6 years experience improving product metrics for a product feature or experience in a market (e.g. growing customer base expanding customer usage avoiding customer churn).
- 6 years experience disrupting a market for a product feature or experience (e.g. competitive disruption taking the place of an established competing product).
- Experience as a product owner or architect for large-scale cloud AI or distributed systems platforms with the ability to reason end to end from hardware to service.
- Experience with LLMs model-serving platforms GPU infrastructure or large-scale AI-powered products.
- Track record of building AI-driven or automated products that replace manual operational processes.
- Experience taking on ambiguous high-stakes work and driving it independently from strategy through execution across organizations.
- Proven ability to think at the platform level while keeping a strong customer mindsettranslating customer and partner needs into durable platform capabilities.
- Experience leading large-scale cloud infrastructure capacity planning or distributed systems work with grasp of hyperscale service delivery.
- Experience with LLMs model-serving platforms GPU capacity planning or large-scale AI-powered products.
- AI fluency including using AI agents automation and prototyping to speed up analysis decisions and product work.
- Experience using telemetry demand signals and operational data to guide platform and investment decisions.
- Experience mentoring and developing product managers and technical leaders.
- Systems-level problem solving and clear communication with the ability to influence senior leaders and align stakeholders across organizations.
Product Management IC5 - The typical base pay range for this role across the U.S. is USD $142800 - $274800 per year. There is a different range applicable to specific work locations within the San Francisco Bay area and New York City metropolitan area and the base pay range for this role in those locations is USD $188000 - $304200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
position will be open for a minimum of 5 days with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age ancestry citizenship color family or medical care leave gender identity or expression genetic information immigration status marital status medical condition national origin physical or mental disability political affiliation protected veteran or military status race ethnicity religion sex (including pregnancy) sexual orientation or any other characteristic protected by applicable local laws regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process read more about requesting accommodations.
Required Experience:
IC
