Senior Software Development Engineer AI

Were building a world of health around every individual shaping a more connected convenient and compassionate health experience. At CVS Health youll be surrounded by passionate colleagues who care deeply innovate with purpose hold ourselvesaccountable and prioritize safety and quality in everything we do. Join us and be part of something bigger helping to simplify health care one person one family and one community at a time.

Position Summary

We are seeking an experienced AI / LLM Engineer to design develop and operationalize advanced language modelpowered applications for enterprise use cases. This role will focus on building text-based reasoning systems Retrieval-Augmented Generation (RAG) pipelines and scalable prompt engineering frameworks that enhance decision-making automation and knowledge discovery across the organization.

As a key member of a cross-functional team you will collaborate with business stakeholders to translate business requirements into reliable explainable and production-ready AI solutions. You will play a critical role in shaping enterprise AI capabilities by ensuring solutions are secure responsible and optimized for real-world performance.

Required Qualifications

• Strong programming experience in Python and familiarity with software engineering best practices.

• Hands-on experience building production-grade AI/ML systems not just prototypes.

• Experience working with Large Language Models (LLMs) and APIs.

• Solid understanding of:

  • Natural Language Processing (NLP) fundamentals

  • Machine learning concepts (training evaluation overfitting bias)

• Practical experience with:

  • Retrieval-Augmented Generation (RAG) systems

  • Prompt engineering and prompt optimization

  • Embeddings and vector search

• Experience designing and implementing APIs microservices or distributed systems.

• Familiarity with model evaluation techniques and performance metrics.

• Strong debugging and problem-solving skills in complex systems.

Preferred Qualifications

• Experience with LLM platforms such as OpenAI Anthropic Google Vertex AI or similar.

• Familiarity with orchestration frameworks like LangChain LlamaIndex Semantic Kernel or equivalent.

• Experience with vector databases (e.g. Pinecone Weaviate FAISS MongoDB Atlas Vector Search).

• Knowledge of MLOps practices including CI/CD pipelines for AI systems.

• Experience deploying solutions in cloud environments (e.g. AWS Azure GCP).

• Exposure to agent-based architectures or multi-step AI workflows.

• Experience in financial services enterprise environments (or similar data-intensive industries).

• Experience with evaluation frameworks and benchmarking for LLMs.

Tools and Technologies

• Programming: Python (primary) SQL

• LLM Platforms: OpenAI Anthropic Google Vertex AI

• Frameworks: LangChain LlamaIndex Semantic Kernel

• Vector Databases: Pinecone Weaviate FAISS MongoDB Atlas Vector Search

• Data Processing: Spark Pandas

• APIs & Services: FastAPI Flask REST/gRPC

• Cloud Platforms: AWS Azure Google Cloud Platform (GCP)

• DevOps & MLOps: Docker Kubernetes CI/CD tools

• Monitoring & Evaluation: Prompt evaluation tools logging frameworks observability platforms

Education

Bachelors or Masters degree in Computer Science Engineering Data Science or a related field or equivalent practical experience.

Anticipated Weekly Hours

Time Type

Pay Range

The typical pay range for this role is:

This pay range represents the base hourly rate or base annual full-time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience education geography and other relevant factors. This position is eligible for a CVS Health bonus commission or short-term incentive program in addition to the base pay range listed above.

Our people fuel our future. Our teams reflect the customers patients members and communities we serve and we are committed to fostering a workplace where every colleague feels valued and that they belong.

Great benefits for great people

We take pride in offering a comprehensive and competitive mix of pay and benefits that reflects our commitment to our colleagues and their families.

Additional details about available benefits are provided during the application process and on Benefits Moments.

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal state and local laws.