Enter a job title or keyword
Principal AI System Architect
Job Location:
Job Location:
San Jose, CA - USA
Yearly Salary:
USD 220000 - 280000
Yearly Salary:
Posted:
29 September 2026 (5 days ago)
Posted:
Application Deadline:
27 December 2026
Application Deadline:
Vacancies:
1 Vacancy
Vacancies:
Job Summary
Description
Credo is looking for a Principal AI System Architect to join our team in San Jose CA reporting to AVP XPU system AI interface. This role needs to solve the system-level interconnection challenges that connect XPUs (NPU/GPU/custom silicon) into working AI infrastructure. This role needs to follow and define how compute elements are wired networked and orchestrated together at node rack and cluster scale so that large-scale LLM training and inference run efficiently across the platform. We strongly prefer candidates with a hands-on NPU hardware background and real experience taking NPU silicon into production deployment at scale.
Base salary range is $220000 - $280000 a year. The base salary offer will depend on factors such as education experience training skills qualifications and location. This position is also eligible for a discretionary bonus equity and a full range of medical and other benefits.
Why Credo
Credo is looking for a Principal AI System Architect to join our team in San Jose CA reporting to AVP XPU system AI interface. This role needs to solve the system-level interconnection challenges that connect XPUs (NPU/GPU/custom silicon) into working AI infrastructure. This role needs to follow and define how compute elements are wired networked and orchestrated together at node rack and cluster scale so that large-scale LLM training and inference run efficiently across the platform. We strongly prefer candidates with a hands-on NPU hardware background and real experience taking NPU silicon into production deployment at scale.
Base salary range is $220000 - $280000 a year. The base salary offer will depend on factors such as education experience training skills qualifications and location. This position is also eligible for a discretionary bonus equity and a full range of medical and other benefits.
Why Credo
- Purpose: We invest in what matters. From meaningful-future shaping projects to competitive compensation we empower you to grow your career while making a lasting impact.
- People: Connection starts within. We collaborate celebrate wins and create an environment where everyone can do their best work.
- Possibilities: Our belief shapes whats next. Our technology powers the most reliable and energy-efficient connections around the world and our team powers new products and markets that come next.
Requirements
Basic Qualifications
Basic Qualifications
- Bachelors degree in Computer Engineering Electrical Engineering Computer Science or related field required
- Ten years in XPU or AI interconnect system design architecture and micro architecture working experience.
- Five cycles of complete ASIC tapeouts.
- Strong foundational understanding of computer architecture including GPU NPU and/or CPU design principles; deep hands-on NPU hardware architecture expertise.
- Familiarity with large language model architectures and distributed training/inference concepts (e.g. parallelism strategies model serving) through coursework research or personal projects.
- Demonstrated analytical ability for example through published research thesis work or quantitative project work- with a track record of independently studying and synthesizing technical material.
- Strong cross-functional leadership and communication skills daily experience working with compiler software SOC & backend team.
- Masters degree or PhD in a relevant technical field.
- Direct NPU tapeout and production ramp experience.
- Hands-on NPU hardware background with direct experience carrying an NPU design from architecture definition through silicon bring-up validation and volume production deployment.
- Working knowledge of high-speed interconnect or networking concepts (e.g. PCIe Ethernet RDMA).
Required Experience:
Staff IC
About Company
Credo delivers high-speed, energy-efficient connectivity solutions powering AI, cloud computing, and hyperscale networks up to 1.6T.
