AzureDatabricks Data Engineer

Azure/Databricks Data Engineer role supporting the Consolidated Edison Digital Products & Customer Energy Solutions team. This is a long-term hybrid contract focused on building scalable data pipelines and analytics solutions for energy and smart grid initiatives.

Databricks Certified Data Engineer Associate is required- MUST SEE COPY-

Job Location - 4 Irving Place New York New York United States of America 10003

Job Description -

Platform Experience:

The candidate should have hands-on experience with various Azure services including but not limited to Azure Data Factory Databricks Data Lake and Power BI.

They should be able to design build and maintain ETL pipelines manage data lakes and create insightful reports and visualizations.

Experience with Azure SQL Database Azure Synapse Analytics Azure COSMOS DB Azure ML other Azure services is a plus.

SQL skill is a must to have C# skills will be a great plus.

Data Engineer: Design implement and maintain data solutions using Azure cloud services. Develop ETL processes optimize data pipelines and ensure data quality and security. Collaborate with teams to deliver scalable data architecture supporting analytics and business intelligence.

on Azure Platform:

The candidate should have a strong understanding of security protocols within the Azure platform.

This includes knowledge of identity and access management network security encryption methods secure data communication and securing serverless architectures.

Governance:

The candidate should have experience in implementing data governance strategies.

This includes setting up data governance frameworks defining data ownership ensuring data quality and implementing data privacy and compliance measures.

Knowledge of data cataloging data lineage and metadata management is also important.

: Azure certifications such as Azure Security Engineer Associate or Azure Solutions Architect Expert are highly desirable. . Databricks Machine Learning Certificate Preferable.