Data Engineer MS Fabric

Overview

We are looking for a Senior Data Engineer with strong 7-10 year hands-on experience in Azure and Microsoft Fabric to help modernize and migrate data products from Azure Synapse to Microsoft Fabric. The ideal candidate will have experience with Azure Data Factory notebooks Spark/PySpark and building scalable data pipelines that support analytics and business reporting needs.

Responsibilities

• Migrate existing data products code and workloads from Azure Synapse to Microsoft Fabric
• Design build and support scalable data pipelines and data processing workflows
• Develop and enhance data products that support business and analytics use cases
• Build solutions using Azure Data Factory notebooks Spark/PySpark SQL and Python
• Refactor pandas-based transformation logic into scalable PySpark and Python implementations
• Work with structured and semi-structured data to enable downstream consumption
• Implement full delta and CDC-based ingestion patterns from multiple data sources
• Apply data warehousing concepts and medallion architecture principles in solution design
• Validate migrated code and data outputs to ensure accuracy consistency and completeness
• Perform data quality checks performance tuning monitoring and issue resolution
• Troubleshoot pipeline code and environment issues across Azure-based platforms
• Collaborate with data analysts engineers and business stakeholders to gather requirements and deliver solutions
• Document technical designs migration approaches and data product logic
• Support code reviews testing release and deployment activities

Required Technical Skills

• 7-10 years of strong hands-on experience with Microsoft Fabric and Azure fundamentals
• Strong hands-on experience with Azure Synapse and Azure Data Factory
• Strong hands-on experience with Spark and PySpark
• Proficiency in Python and SQL
• Experience with pandas and refactoring to PySpark/Spark-based implementations
• Strong experience with Git and Azure DevOps including pull requests CI/CD and deployment automation
• Experience building reusable engineering patterns and shared libraries
• Solid understanding of Azure storage compute security and identity
• Strong knowledge of data modeling data transformation and warehousing concepts
• Experience with performance optimization and tuning

Technologies Platforms and Tools

• Microsoft Fabric
• Microsoft Azure Fundamentals
• Azure Data Factory
• Preferred knowledge on source systems such as SAP ECC S/4 HANA Oracle ERP Salesforce
• Worked with Delta Parquet JSON and CSV file formats
• Azure DevOps Terraform