Lead Cloud Data Engineer (Data Mesh & AI)

Stefanini Group is hiring!

Stefanini is looking for a Lead Cloud Data Engineer (Data Mesh & AI) for San Francisco CA/Los Angeles CA (Onsite)

For quick Apply please reach out to Prakhar Goel: /

W2 candidates Preferred!

We are seeking an experienced Lead Data Engineer to join our team and drive the development of modern data platforms and AI-augmented solutions. This role is critical to supporting ongoing operations of Large Data Warehouse architecting the Large Data Hub and preparing for the enterprise data mesh modernization program.

Responsibilities:

Data Engineering & Pipeline Development:

1. Develop and maintain end-to-end ETL/ELT pipelines for data ingestion from multiple sources (databases APIs streaming) transformation quality validation data modeling and consumption layer optimization using AWS services (Glue EMR Lambda Kinesis Step Functions)
2. Implement data governance policies metadata management data lineage tracking fine-grained access controls and automated data quality frameworks with validation rules anomaly detection and monitoring/alerting mechanisms

Data Mesh Architecture:

1. Design and implement Data Mesh architecture on AWS with federated governance defining domain boundaries data product specifications and self-serve infrastructure patterns across Databricks Starburst Collibra and Immuta platforms
2. Develop reusable frameworks accelerators and self-serve tools enabling domain teams to independently publish discover and consume data products while ensuring performance optimization and cost efficiency

DevSecOps & Infrastructure:

AI-Augmented Development:

Technical Leadership & Collaboration:

1. Provide L3 technical support and mentor engineering teams on data mesh principles and modern data technologies
2. Collaborate with stakeholders to translate business requirements into technical solutions
3. Lead architecture design reviews and create comprehensive technical documentation

#LI-PG1

#LI-ONSITE

Qualifications:

Data Mesh Architecture & AWS (5 years required):

1. Deep experience designing distributed data architectures on AWS (S3 Glue Lake Formation EMR Redshift)
2. Hands-on implementation of data mesh principles including domain-oriented data ownership data as a product and federated computational governance

Modern Data Platform Technologies:

1. Proficiency: Databricks (Unity Catalog Delta Lake) Starburst/Trino (federated query) Collibra (data governance) or Immuta (dynamic data access control)
2. Ability to architect multi-technology solutions

DevSecOps & Infrastructure as Code:

1. Strong experience with CI/CD pipelines (GitLab/GitHub Actions Jenkins)
2. Containerization expertise (Docker/ECS)
3. Infrastructure automation (Terraform CloudFormation)
4. Security compliance frameworks for AWS GovCloud environments

AI-Augmented Development & Engineering:

1. Demonstrated use of generative AI tools for accelerating SDLC activities including code generation testing and documentation
2. Experience designing or implementing agentic AI solutions using Amazon Bedrock or similar frameworks

Leadership & Soft Skills

1. Proven ability to translate business requirements into technical solutions
2. Experience leading technical design sessions and mentoring engineering teams
3. Strong communication skills to convey complex architectural concepts to both technical and non-technical stakeholders
4. Experience working across hybrid cloud/on-premises environments

Listed salary ranges may vary based on experience qualifications and local market. Also some positions may include bonuses or other incentives.

Stefanini takes pride in hiring top talent and developing relationships with our future employees. Our talent acquisition teams will never make an offer of employment without having a phone conversation with you. Those face-to-face conversations will involve a description of the job for which you have applied. We also speak with you about the process including interviews and job offers.

About Stefanini Group:

The Stefanini Group is a global provider of offshore onshore and near shore outsourcing IT digital consulting systems integration application and strategic staffing services to Fortune 1000 enterprises around the world. Our presence is in countries like the Americas Europe Africa and Asia and more than four hundred clients across a broad spectrum of markets including financial services manufacturing telecommunications chemical services technology public sector and utilities. Stefanini is a CMM level 5 IT consulting company with a global presence. We are CMM Level 5 company.