Senior Data Engineer with Python
Job Location:
Monthly Salary:
Posted on:
Vacancies:
Job Summary
Job Description:
-
Design develop and manage scalable and secure data pipelines using Databricks and PySpark.
-
Architect and implement cloud-based data solutions integrating structured and unstructured data sources.
-
Write clean efficient and reusable code primarily in Python for cloud automation data processing and orchestration.
-
Build and optimize ETL workflows and ensure seamless data integration across platforms.
-
Develop data models using normalization and denormalization techniques to support OLTP and OLAP systems.
-
Troubleshoot performance bottlenecks in data flows and ETL processes.
-
Integrate advanced analytics and support BI use cases within the Cloud ecosystem.
-
Lead code reviews and ensure adherence to version control practices (e.g. Git).
-
Contribute to the design and deployment of enterprise-level data warehousing solutions.
-
Stay current with Cloud technologies and Python ecosystem updates to adopt best practices and emerging tools.
