Enter a job title or keyword
ML Fine-Tuning Engineer
Job Location:
Monthly Salary:
Not provided by the employer
Monthly Salary:
Experience Required:
5years
Experience Required:
Posted:
9 September 2026 (3 days ago)
Posted:
Application Deadline:
7 December 2026
Application Deadline:
Vacancies:
1 Vacancy
Vacancies:
Job Summary
Job Title:ML / Fine-Tuning Engineer
Location: Hyderabad OR Pune
Notice Period : 0-30 Days
Mode of Work:Hybrid
Experience :5 Years
We are looking for ML / Fine-Tuning Engineer who can deliver (under supervision of ProServe Tech Lead) the end-to-end fine-tuning of open-source LLMs for a narrow high-volume production task on AWS SFT and alignment experiments (GRPO DPO) debugging training on multi-GPU clusters and iterating to strict accuracy targets. Models from 8B to 70B parameters.
What We Expect:
- Fine-tune open-source LLMs (Qwen Llama) from experiment to production-ready checkpoint
- Run SFT and RL alignment (GRPO DPO) to improve output accuracy
- Execute training on AWS GPU instances (p4d p5 g5) using distributed training
- Diagnose/fix training issues: loss imbalances OOM errors gradient instabilities
- Collaborate with evaluation and data engineering to iterate on quality gaps
- Make data-driven model scaling decisions (8B 14B 70B) based on offline metrics
Requirements
- Experience: 5 years ML engineering with 2 years in LLM fine-tuning
- LLM Models: Hands-on with open-source LLMs Qwen and Llama required
- Training Methods: SFT LoRA/QLoRA GRPO DPO/RLHF
- Frameworks: NVIDIA NeMo/NeMoRL VeRL HuggingFace TRL must have used at least two
- Distributed Training: DeepSpeed ZeRO FSDP2 multi-node GPU orchestration
- AWS Infrastructure: p4d/p5/g5 GPU instances SageMaker Training Jobs
- Languages: Python PyTorch; CUDA debugging a plus
Preferred (Not Required): Fine-tuning for tool-calling/agent tasks; multi-node GRPO/RLHF with NeMoRL or VeRL; tokenizer internals and chat-template rendering for tool-use formats.
Benefits
- Comprehensive Medical Coverage:
Health insurance of INR 5.0 Lakhs for you and your family (up to 6 members) ensuring complete peace of mind. - Robust Protection Plans:
Group Personal Accident Insurance and Group Term Life Insurance to safeguard you and your loved ones. - Retirement Benefits:
PF and Gratuity provided as per standard government regulations. - Flexible Work Options:
Enjoy hybrid work arrangements & flexible working hours. - Generous Leave Policy:
21 days of annual leave in addition to 10 company-declared holidays. - Employee Well-being Spaces:
Access to a dedicated break-out area with round-the-clock refreshments for relaxation and rejuvenation.
Required Skills:
SFT LoRA/QLoRA LLM Deepspeed AWS GPU Sagemaker
Required Education:
Btech/M tech
