Gen AIPython Databricks
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
- End to end support operations for GenAI platforms LLM based applications and AI agent workflows including APIs and service based architectures.
- Analyze business and technical specifications related to AI solutions integrations and backend services.
- Demonstrate strong understanding of LLMs prompt behavior AI agents orchestration workflows and inference pipelines.
- Monitor and validate LLM prompt responses hallucination risks and AI safety issues in production environments.
- Design and execute validation and test plans for LLMs and AI agents including regression testing after model prompt or configuration changes.
- Support and troubleshoot Python based GenAI services built using frameworks such as FastAPI Flask or similar microservice frameworks.
- Debug and analyze API level issues related to request/response handling latency auth payload structure and model inference outcomes.
- Manage incidents problems changes and service requests using ServiceNow (SNOW).
- Perform root cause analysis (RCA) for recurring AI model or service level issues and drive preventive/remediation actions.
- Coordinate closely with engineering QA product and governance teams for fixes releases deployments and enhancements.
- Work with tools such as Postman Git and monitoring/observability platforms for GenAI services.
- Ensure SLA/SLO adherence track operational health and provide metrics dashboards and reports for GenAI platforms.
- Maintain runbooks SOPs knowledge articles and production support documentation.
- Support Responsible AI (RAI) practices including governance checks safety validations and compliance requirements.
- Possess strong programming knowledge in Python with the ability to read debug and support service code.
- Bring strong experience in ServiceNow (SNOW) Incident Problem Change and Knowledge Management.