Enter a job title or keyword

Vice President, Machine Learning & Systems Compiler Engineering


Job Location:

California, CA - USA

Salary: Not provided by the employer
Posted: 16 September 2026 (19 hours ago)
Application Deadline: 14 December 2026
Vacancies: 1 Vacancy

Job Summary

What You Will Build

Compiler Architecture & Intermediate Representations

Architect and evolve our clients compiler IR strategy building on MLIR/LLVM infrastructure to lower high-

level ML graphs into hardware-aware representations for RISC-V and AI accelerator execution

Design and own custom dialects optimization passes and lowering pipelines that map cleanly onto ASHAIs

vector and accelerator ISA extensions

Set the multi-year technical roadmap for the compiler stack balancing near-term customer performance

commitments against long-term platform scalability

Graph-Level Optimization & Performance Engineering

Drive graph transformations operator fusion pattern rewriting quantization and memory planning strategies

that materially reduce latency and increase throughput on our clients hardware

Own performance benchmarking of the compiler stack against GPU baselines: tokens per second cost per

token and memory efficiency

Profile debug and tune computational kernels including matrix multiplication attention and other core

inference operators to close the gap between theoretical and achieved performance

Toolchain SDK & Developer Platform

Design build and maintain a scalable production-grade compiler toolchain and SDK APIs that customers use

to compile and deploy models on our clients hardware

Own RISC-V toolchain integration: compiler support ABI compatibility and build system tooling for ASHAI-

optimized binaries

Establish automated testing benchmarking and CI/CD infrastructure that keeps the compiler stack stable as it

scalesTeam Building & Technical Leadership

Recruit hire and lead a world-class compiler engineering team from the ground up setting hiring bar technical

direction and career growth paths

Guide engineers through code review design review and mentorship practices that keep the codebase and team

execution at a high standard

Evaluate and integrate learning-based and agent-assisted approaches into the compilation pipeline and the

teams own development practices where they measurably improve outcomes

Hardware/Software Co-Design & Cross-Functional Collaboration

Partner directly with the SoC Architecture team to align compiler capabilities with the constraints and

opportunities of our clients custom silicon informing ISA extension and microarchitecture decisions

Partner with the VP System & Applications Engineering on the boundary between the compiler stack and the

runtime HAL and developer SDK keeping API contracts and framework integration paths coherent end to end

Represent the compiler teams perspective in architecture reviews ensuring compiler and code-generation

requirements are first-class inputs to silicon decisions

Open-Source Engagement

Actively participate in contribute upstream to and track major open-source compiler ecosystems relevant to

our clients stack including LLVM MLIR OpenXLA/StableHLO Triton and TVM

Represent our client in the broader ML compiler community building the companys credibility and visibility

among framework and hardware ecosystem partners

What We Are Looking For

Required Experience

15 years in compiler/systems engineering including 5 years leading a compiler team

Expert in modern C/C and Python on Linux

Deep expertise in compiler fundamentals IRs and hands-on LLVM/MLIR experience

Familiarity with major DL frameworks: PyTorch TensorFlow or JAX

Strong foundation in data structures graph algorithms and optimization techniques

Proven ability to build and lead cross-disciplinary engineering teams

Strongly Preferred

Experience mapping code to GPUs TPUs NPUs or custom AI accelerators

Background in instruction selection register allocation or SIMD/vectorization

Experience with OpenXLA StableHLO TVM or Triton

RISC-V depth: privilege levels RVV extension LLVM/GCC toolchain and ABI conventions; ecosystem

contributions a plus

Track record shipping compiler software to web-scale cloud or embedded environments

Familiarity with Bazel/CMake and CI/CD pipelines

Experience taking a new platforms compiler from zero to production-ready

Leadership Qualities

Operates at both strategic and implementation levels: can set compiler architecture direction and contribute

directly on critical-path components

Track record of building high-performing compiler or systems teams from a small base including hiring

mentoring and setting technical culture

Strong communicator across technical and business audiences; able to translate compiler performance work into

customer-facing throughput cost and latency terms

High tolerance for greenfield ambiguity: this role requires defining structure and priorities where none currently

exist