Vice President, Machine Learning & Systems Compiler Engineering
California, CA - USA
Job Summary
What You Will Build
Compiler Architecture & Intermediate Representations
Architect and evolve our clients compiler IR strategy building on MLIR/LLVM infrastructure to lower high-
level ML graphs into hardware-aware representations for RISC-V and AI accelerator execution
Design and own custom dialects optimization passes and lowering pipelines that map cleanly onto ASHAIs
vector and accelerator ISA extensions
Set the multi-year technical roadmap for the compiler stack balancing near-term customer performance
commitments against long-term platform scalability
Graph-Level Optimization & Performance Engineering
Drive graph transformations operator fusion pattern rewriting quantization and memory planning strategies
that materially reduce latency and increase throughput on our clients hardware
Own performance benchmarking of the compiler stack against GPU baselines: tokens per second cost per
token and memory efficiency
Profile debug and tune computational kernels including matrix multiplication attention and other core
inference operators to close the gap between theoretical and achieved performance
Toolchain SDK & Developer Platform
Design build and maintain a scalable production-grade compiler toolchain and SDK APIs that customers use
to compile and deploy models on our clients hardware
Own RISC-V toolchain integration: compiler support ABI compatibility and build system tooling for ASHAI-
optimized binaries
Establish automated testing benchmarking and CI/CD infrastructure that keeps the compiler stack stable as it
scalesTeam Building & Technical Leadership
Recruit hire and lead a world-class compiler engineering team from the ground up setting hiring bar technical
direction and career growth paths
Guide engineers through code review design review and mentorship practices that keep the codebase and team
execution at a high standard
Evaluate and integrate learning-based and agent-assisted approaches into the compilation pipeline and the
teams own development practices where they measurably improve outcomes
Hardware/Software Co-Design & Cross-Functional Collaboration
Partner directly with the SoC Architecture team to align compiler capabilities with the constraints and
opportunities of our clients custom silicon informing ISA extension and microarchitecture decisions
Partner with the VP System & Applications Engineering on the boundary between the compiler stack and the
runtime HAL and developer SDK keeping API contracts and framework integration paths coherent end to end
Represent the compiler teams perspective in architecture reviews ensuring compiler and code-generation
requirements are first-class inputs to silicon decisions
Open-Source Engagement
Actively participate in contribute upstream to and track major open-source compiler ecosystems relevant to
our clients stack including LLVM MLIR OpenXLA/StableHLO Triton and TVM
Represent our client in the broader ML compiler community building the companys credibility and visibility
among framework and hardware ecosystem partners
What We Are Looking For
Required Experience
15 years in compiler/systems engineering including 5 years leading a compiler team
Expert in modern C/C and Python on Linux
Deep expertise in compiler fundamentals IRs and hands-on LLVM/MLIR experience
Familiarity with major DL frameworks: PyTorch TensorFlow or JAX
Strong foundation in data structures graph algorithms and optimization techniques
Proven ability to build and lead cross-disciplinary engineering teams
Strongly Preferred
Experience mapping code to GPUs TPUs NPUs or custom AI accelerators
Background in instruction selection register allocation or SIMD/vectorization
Experience with OpenXLA StableHLO TVM or Triton
RISC-V depth: privilege levels RVV extension LLVM/GCC toolchain and ABI conventions; ecosystem
contributions a plus
Track record shipping compiler software to web-scale cloud or embedded environments
Familiarity with Bazel/CMake and CI/CD pipelines
Experience taking a new platforms compiler from zero to production-ready
Leadership Qualities
Operates at both strategic and implementation levels: can set compiler architecture direction and contribute
directly on critical-path components
Track record of building high-performing compiler or systems teams from a small base including hiring
mentoring and setting technical culture
Strong communicator across technical and business audiences; able to translate compiler performance work into
customer-facing throughput cost and latency terms
High tolerance for greenfield ambiguity: this role requires defining structure and priorities where none currently
exist