Lead Data Engineer Data Platform
Job Location:
Monthly Salary:
Posted on:
Vacancies:
Job Summary
We are looking for a visionary Data Platform Engineer to own scale and nurture our platform engineering team and data infrastructure across Databricks and Snowflake ecosystems. You will set the strategic direction for Capitas Enterprise Data Platform be the custodians of the platform mentor team members and drive the development of robust scalable foundational data pipelines transformations and data models that underpin business insights and operational reporting. You will ensure engineering best practices data quality and reliability are maintained across platforms.
Job title:
Lead Data Engineer - Data PlatformJob Description:
- Define and drive the technical roadmap and strategy for the data platform on Databricks and Snowflake ensuring scalability security and cost efficiency.
- Design implement and maintain the platforms infrastructure using Infrastructure as Code (IaC) tools such as Terraform or BICEP/ARM.
- Drive platform automation and operational excellence for deployment environment provisioning monitoring and self-service capabilities using Azure DevOps/CI/CD.
- Establish and enforce engineering best practices including robust code quality automated testing observability and security governance across the platform.
- Mentor and nurture the platform engineering team promoting a culture of continuous learning and high-quality delivery.
- Collaborate with data engineering teams security and senior stakeholders to ensure platform capabilities align with business needs and enterprise standards.
- Monitor and manage cloud resource consumption across Databricks and Snowflake to drive cost efficiency and implement FinOps best practices.
- Establish monitor and enforce Service Level Agreements (SLAs) and Non-Functional Requirements (NFRs) for platform performance availability and throughput.
- Define and implement data quality enforcement mechanisms and robust access control policies (e.g. RBAC/ABAC) utilising features like Databricks Unity Catalog or Snowflake Roles.
Location:
PuneIndiaTime Type:
Full timeContract Type:
PermanentRequired Experience:
IC
About Company
We help millions of people each day with digitally-enabled solutions to transform and simplify the connections between government & citizens, businesses & customers.
