Azure Data Engineer –100 Remote
Job Location:
Monthly Salary:
Posted on:
2 days ago
Posted on:
Vacancies:
1 Vacancy
Vacancies:
Job Summary
Job Title: Azure Data Engineer - HCSC
Experience:5 Years
Location:Remote
Contract Tenure:6 Months
Rate:80-90KPM
Mandatory Skills
- Azure Data Engineering
- Azure Databricks
- Python
- PySpark
- Hive
- Sqoop
- Hadoop
- Unix Shell Scripting
- CI/CD (Azure DevOps or similar)
- Performance Tuning in Databricks
- ETL Pipeline Development
- Excellent Communication Skills
Responsibilities
- Design develop and maintain scalable data pipelines using Azure Databricks Python and PySpark.
- Build and optimize ETL processes for large-scale data processing.
- Perform performance tuning and optimization of Databricks workloads handling high-volume data.
- Develop and maintain Unix shell scripts for automation and operational tasks.
- Work with Big Data technologies including Hive Sqoop and Hadoop.
- Implement and manage CI/CD pipelines for ETL deployments using DevOps tools.
- Schedule and monitor batch jobs using tools such as Ctrl-M.
- Collaborate with client stakeholders to understand business requirements and deliver high-quality data solutions.
- Troubleshoot production issues and ensure timely resolution.
- Work independently while maintaining effective communication with client and project teams.
Required Skills:
Azure data engineerAzure databricks
