Data Engineer
Job Location:
Monthly Salary:
Posted on:
30+ days ago
Posted on:
Vacancies:
1 Vacancy
Vacancies:
Job Summary
Our client RibbitZ is looking for Data Engineer (AI/BI) Databricks-Centric to work remotely.
Job Description:
Availability: Must be available until 4:30 PM ET (USA)
We are looking for an experienced Data Engineer with strong AI Platform Engineering expertise to build and scale modern data and AI solutions in a Databricks-centric environment.
Key Responsibilities:
- Build and scale Databricks AI/BI solutions (dashboards Genie experiences data pipelines)
- Develop ETL/ELT pipelines using Apache Spark and Delta Lake (Medallion Architecture)
- Integrate data from enterprise systems like PeopleSoft Salesforce and D2L
- Ensure data quality governance and security (Unity Catalog encryption access control)
- Enable AI/ML teams with high-quality datasets and feature stores
- Design and architect cloud data lakes and data marts (ADLS S3)
- Document and enable teams on Databricks governance and architecture best practices
- Support AIOps/MLOps workflows using MLflow (experiment tracking model registry deployment)
Required Skills & Experience:
- Strong hands-on experience with Databricks (Delta Lake Apache Spark)
- Experience building ELT pipelines and Medallion Architecture
- Proficiency in SQL Python or Scala
- Experience integrating enterprise platforms and systems
- Strong knowledge of data governance and metadata management
- Must have experience in AI Platform Engineering
Preferred Qualifications:
- Experience with Databricks Unity Catalog
- Experience in AI/ML model deployment (MLflow)
- Exposure to AIOps lifecycle workflows
- Cloud experience with Azure or AWS
- Knowledge of data warehouse design
