DE&A Core Advanced Visualization & Cloud Reporting Azure Analysis Services

Role Overview

We are seeking a skilled Data Integration & Middleware Engineer to implement and manage scalable data pipelines and middleware solutions. The role will focus on orchestrating data workflows using Azure technologies such as Azure Data Factory (ADF) Azure Blob Storage and Azure SQL Database ensuring efficient ETL/ELT processing and high-quality data delivery.

Key Responsibilities

• Manage end-to-end data integration pipelinesusing Azure Data Factory (ADF)
• Orchestrate and monitor data workflows ensuring reliability performance and error handling
• Implement Manage ETL/ELT processesfor data ingestion transformation and loading
• Manage and optimize data storage solutionsusing Azure Blob Storage
• Maintain structured data modelsin Azure SQL Database / Azure DB
• Ensure data quality validation and governanceacross pipelines
• Support integration with on-premise and cloud-based systems
• Perform performance tuning and cost optimizationacross the data platform

Technical Skills Required

Core Skills Must Have

• Strong experience with Azure Data Factory (ADF)for orchestration
• Hands-on experience with ETL/ELT development
• Experience with Azure Blob Storage / Data Lake
• Proficiency in Azure SQL Database / SQL Server
• Understanding of data warehousing concepts and data modeling
• Knowledge of DevOps CI/CD pipelinesfor data workflows

Nice to Have

• Experience with Azure Databricks or Synapse Analytics
• Knowledge of data pipeline optimization and monitoring
• Familiarity with API integrations and data connectors
• Exposure to data governance and security practices
• Azure certifications (e.g. AZ-900 DP-203)
• Experience with real-time data processing frameworks(Event Hub Service Bus)

Soft Skills

• Strong analytical and problem-solving abilities
• Clear communication and stakeholder management skills
• Ability to work in a collaborative cross-functional environment
• Attention to detail and commitment to data quality