Lead AI Engineer – Quality Engineering
Ho Chi Minh City - Vietnam
Department:
Job Summary
We are looking for a Lead AI Engineer to design build and operate intelligent agents that automate software testing end-to-end.
This is an AI engineering role applied to quality engineering not a traditional test automation role with AI added on top. You will own agentic workflows across test-case generation automation-script creation execution validation failure analysis self-healing and continuous test maintenance. The role integrates AI agents with application knowledge automation tools APIs databases and CI/CD pipelines to enable reliable end-to-end testing and sets the technical direction for how agentic quality engineering is delivered across teams.
You will lead the technical direction of this capability and mentor a team of engineers (team size: TBC) as the practice scales.
Key Responsibilities
Build agentic systems
- Design and develop autonomous and multi-agent workflows for test automation.
- Build AI agents using LLMs prompt engineering RAG tool calling and MCP-based integrations.
- Develop agents for test generation code creation validation debugging failure triage and self-healing.
- Maintain application knowledge bases (embeddings retrieval context strategy) and continuously improve agent decision-making.
Make them reliable
- Define agent instructions guardrails validation checkpoints and human-in-the-loop review processes.
- Establish evaluation practice: golden datasets regression evals LLM-as-judge where appropriate and clear accuracy/reliability metrics.
- Instrument agents with tracing and observability; monitor and improve accuracy reliability latency token cost and maintainability in production.
Integrate and ship
- Integrate agents with UI API database and end-to-end testing workflows.
- Integrate agentic solutions with GitHub Jenkins APIs databases and other engineering tools.
Lead
- Set technical standards and best practices for agentic development and AI-assisted testing.
- Mentor engineers run design reviews and raise the teams level of AI engineering maturity.
Qualifications :
Must Have
- 6 years of software engineering experience including proven experience leading technical delivery or mentoring engineers.
- 1.5 years building LLM-based or agentic systems that reached production not proof-of-concept work only.
- Strong hands-on experience with LLM integration prompt engineering RAG and AI-agent development.
- Proficiency in Python or TypeScript with solid experience building and consuming REST APIs.
- Hands-on experience with at least one agent orchestration framework (e.g. LangGraph OpenAI Agents SDK CrewAI AutoGen Semantic Kernel or equivalent) including tool integration structured outputs and validation mechanisms.
- Practical experience with AI evaluation and observability designing eval datasets measuring agent quality and using tracing tools (e.g. LangSmith Langfuse Arize Phoenix or a custom harness).
- Experience with vector databases embeddings and knowledge management for retrieval.
- Solid understanding of Git CI/CD pipelines and modern software-development practices.
- Good English communication skills for collaborating with distributed teams and stakeholders.
Nice-to-Have
- Working knowledge of Playwright with TypeScript.
- Background in UI API database or end-to-end test automation.
- Familiarity with Angular or React applications.
- Experience with MCP (Model Context Protocol) servers and clients.
- Experience optimizing LLM cost and latency (caching model routing token budgeting).
- Experience with Jenkins or comparable CI orchestration at scale.
Additional Information :
Perks Youll Enjoy
- Working in one of the Best Places to Work in Vietnam
- Building large-scale & global software products
- Working & growing with Passionate & Talented Team
- Diverse careers opportunities with Software Outsourcing Software Product Development IT Solutions & Consulting
- Attractive Salary and Benefits
- Performance appraisal once a year and performance bonus
- Onsite opportunities: short-term and long-term assignments in North American (U.S Canada) Europe Asia.
- Flexible working time
- Various training on hot-trend technologies best practices and soft skills
- Premium healthcare insurance for you and your loved ones
- Company trip big annual year-end party every year team building etc.
- Fitness & sport activities: football tennis table-tennis badminton yoga swimming
- Joining community development activities: 1% Pledge charity every quarter blood donation public seminars career orientation talks
- Free in-house entertainment facilities (foosball ping pong gym) coffee and snack (instant noodles cookies candies)
And much more join us and let yourself explore other fantastic things!
Remote Work :
No
Employment Type :
Full-time
About Company
KMS Technology was established in 2009 as a U.S.-based software services company. With development centers in Vietnam and Mexico, we have been trusted globally for the superlative quality of our software consulting & development services, technology solutions, and engineers' expertise ... View more