Junior Data Engineer
Job Summary
Job Description:
-
Design develop and manage scalable and secure data pipelines using Azure Databricks and Azure Data Factory.
-
Architect and implement cloud-based data solutions integrating structured and unstructured data sources.
-
Write clean efficient and reusable code primarily in Python for cloud automation data processing and orchestration.
-
Build and optimize ETL workflows and ensure seamless data integration across platforms.
-
Develop data models using normalization and denormalization techniques to support OLTP and OLAP systems.
-
Manage Azure-based storage solutions including Azure Data Lake and Blob Storage.
-
Troubleshoot performance bottlenecks in data flows and ETL processes.
-
Integrate advanced analytics and support BI use cases within the Azure ecosystem.
-
Lead code reviews and ensure adherence to version control practices (e.g. Git).
-
Contribute to the design and deployment of enterprise-level data warehousing solutions.
-
Stay current with Azure cloud technologies and Python ecosystem updates to adopt best practices and emerging tools.