Enter a job title or keyword
LLM Engineer
Job Location:
Job Location:
Chapel Hill, NC - USA
Monthly Salary:
Not provided by the employer
Monthly Salary:
Posted:
29 September 2026 (6 days ago)
Posted:
Application Deadline:
27 December 2026
Application Deadline:
Vacancies:
1 Vacancy
Vacancies:
Job Summary
Position Summary
The LLM Engineer will design build and operate large language model-powered tools and applications across the institution. Working within the CAIO office and in close collaboration with the University Library the engineer will contribute to two flagship initiatives: PromptLab UNCs shared generative AI service built on LibreChat and Carolina Source a proposed institutional knowledge platform with a governed retrieval layer and federated applications.
Required Qualifications Competencies And Experience
Bachelors degree in Computer Science Data Science Information Science or a related field Demonstrated experience building and deploying production-grade LLM -powered applications Proficiency in Python and relevant frameworks including LangChain LlamaIndex Hugging Face Transformers or equivalent Experience with RAG architectures vector databases and embedding models Familiarity with major LLM APIs including OpenAI Anthropic Google and open-source alternatives Working knowledge of cloud platforms (Azure AWS or GCP ) and containerization (Docker Kubernetes) Experience with web application development using JavaScript TypeScript or React Experience with platform operations including monitoring incident investigation upgrades and recovery
Preferred Qualifications Competencies And Experience
Masters degree in Computer Science Artificial Intelligence Computational Linguistics Information Science or a related field Experience with LibreChat LiteLLM or similar open-source generative AI platforms Experience designing or implementing enterprise search and knowledge retrieval platforms (Azure AI Search Elasticsearch OpenSearch or equivalent) Familiarity with data governance frameworks access control design and permission-based retrieval architectures Experience building federated application architectures on top of shared knowledge or data platforms
The LLM Engineer will design build and operate large language model-powered tools and applications across the institution. Working within the CAIO office and in close collaboration with the University Library the engineer will contribute to two flagship initiatives: PromptLab UNCs shared generative AI service built on LibreChat and Carolina Source a proposed institutional knowledge platform with a governed retrieval layer and federated applications.
Required Qualifications Competencies And Experience
Bachelors degree in Computer Science Data Science Information Science or a related field Demonstrated experience building and deploying production-grade LLM -powered applications Proficiency in Python and relevant frameworks including LangChain LlamaIndex Hugging Face Transformers or equivalent Experience with RAG architectures vector databases and embedding models Familiarity with major LLM APIs including OpenAI Anthropic Google and open-source alternatives Working knowledge of cloud platforms (Azure AWS or GCP ) and containerization (Docker Kubernetes) Experience with web application development using JavaScript TypeScript or React Experience with platform operations including monitoring incident investigation upgrades and recovery
Preferred Qualifications Competencies And Experience
Masters degree in Computer Science Artificial Intelligence Computational Linguistics Information Science or a related field Experience with LibreChat LiteLLM or similar open-source generative AI platforms Experience designing or implementing enterprise search and knowledge retrieval platforms (Azure AI Search Elasticsearch OpenSearch or equivalent) Familiarity with data governance frameworks access control design and permission-based retrieval architectures Experience building federated application architectures on top of shared knowledge or data platforms
Required Experience:
Staff IC
About Company
The University of North Carolina at Chapel Hill, the nation’s first public university, is a global higher education leader known for innovative teaching, research and public service. A member of the prestigious Association of American Universities, Carolina regularly ranks as the best ... View more
