Tech Lead Manager, Agentic Runtime
Mountain View, CA - USA
Job Summary
The Tech Lead Manager of the Agentic Runtime team builds the lowlatency reliable and secure foundation that powers Gleans AI agents and assistant experiences at scale. Youll design and operate core runtime services for multiturn orchestration tool calling model routing memory streaming and safety. Youll work across distributed systems production observability and ML infra integrations to deliver an experience that feels instant accurate and trustworthy while optimizing cost and reliability.
You will:
- Own impactful runtime problems endtoend from architecture and design to production launch and ongoing reliability.
- Build and evolve core services for session lifecycle streaming responses (e.g. gRPC/WebSockets) structured tool execution memory/state and policy/guardrails.
- Design for performance correctness and cost: reduce p50/p95 latency improve tail behavior and optimize token/tool budgets.
- Integrate with leading LLM providers (e.g. OpenAI Anthropic Google Gemini) and internal evaluation frameworks to improve quality and predictability.
- Harden the platform with fault isolation retries timeouts circuitbreaking backpressure and graceful degradation.
- Instrument deep observability (tracing metrics logs) and create playbooks/SLOs for high availability and oncall excellence.
- Collaborate closely with product quality and application teams to prioritize the most impactful roadmap investments.
About you:
- 8 years of software engineering experience building production distributed systems or cloudnative applications.
- 1 years of engineering management experience
- BS/BA in Computer Science or related field or equivalent practical experience.
- Strong coding skills in at least one of: Python Go Java or C with a focus on reliability performance and tests.
- Productminded: you prioritize customer impact clear SLAs/SLOs and pragmatic iteration.
- Ownershipdriven with a positive proactive attitude; comfortable leading projects or learning from battletested engineers.
- Experience operating services on Kubernetes and at least one major cloud (e.g. GCP AWS or Azure).
- Familiarity with event/streaming systems (e.g. Pub/Sub Kafka) caching (e.g. Redis) and data stores for lowlatency paths.
- Practical understanding of LLM/agents building blocks: tool/function calling structured outputs streaming and model selection/routing.
- Strong observability and debugging skills: tracing (e.g. OpenTelemetry) metrics dashboards and production forensics.
- Background in one or more areas is a plus: policy/guardrails multitenant isolation ratelimiting concurrency control cost optimization.
Location:
- This role is hybrid (4 days a week in either our Mountain View or San Francisco offices)
Compensation & Benefits:
The standard base salary range for this position is $250000 - $300000 annually. Compensation offered will be determined by factors such as location level job-related knowledge skills and experience. Certain roles may be eligible for variable compensation equity and benefits.
We offer a comprehensive benefits package including competitive compensation Medical Vision and Dental coverage generous time-off policy and the opportunity to contribute to your 401k plan to support your long-term goals. When you join youll receive a home office improvement stipend as well as an annual education and wellness stipends to support your growth and wellbeing. We foster a vibrant company culture through regular events and provide healthy lunches daily to keep you fueled and focused.
We are a diverse bunch of people and we want to continue to attract and retain a diverse range of people into our organization. Were committed to an inclusive and diverse company. We do not discriminate based on gender ethnicity sexual orientation religion civil or family status age disability or race.
#LI-HYBRID
By clicking Submit Application I confirm that I have read the Global Data Privacy Notice and the Applicant Arbitration Agreement and I agree to the terms.
Required Experience:
Manager
About Company
Glean was created to deliver healthy and fresh foods - made directly from fruits and vegetables - into your hands! Sweet Potato Flour & Pumpkin Flour now available. Our team is made up of a handful of passionate people who have worked in food and agriculture most of their careers - ... View more