Lead Data Engineer R
Job Location:
Monthly Salary:
Posted on:
30+ days ago
Posted on:
Vacancies:
1 Vacancy
Vacancies:
Job Summary
Lead Data Engineer
Primary Skills
- AKS Event Hub Azure DevOps Cosmos DB Azure Functions
Specialization
- Azure Data Engineering Advanced: Senior Data Engineer
Job requirements
Job Description
We are seeking a Senior Data Engineer with strong handson expertise in Azure Data Platform and Microsoft Fabric to design build and scale modern enterprisegrade data solutions. The role involves working on endtoend data engineering pipelines lakehouse architectures and analyticsready data models using Azure and Fabrics unified analytics capabilities.
Key Responsibilities
- Design develop and manage endtoend data pipelines using Microsoft Fabric (Data Pipelines Lakehouse Warehouse OneLake) and Azure Data Factory
- Build scalable data transformation and processing solutions using Fabric Notebooks PySpark Python and SQL
- Implement Lakehouse and Medallion Architecture (Bronze Silver Gold) to support analytics and reporting workloads
- Develop and optimize SQL-based solutions including TSQL stored procedures and performancetuned queries
- Integrate data from multiple sources including RDBMS APIs files streaming sources and cloud storage
- Work with ADLS Gen2 Blob Storage and OneLake for structured and unstructured data management
- Enable analytics and reporting by integrating Fabric datasets with Power BI
- Implement data quality checks monitoring logging and errorhandling mechanisms
- Support migration and modernization initiatives from ADF / Databricks to Microsoft Fabric where applicable
- Ensure adherence to data governance security lineage and compliance standards (Microsoft Purview exposure preferred)
- Collaborate closely with architects analysts and business stakeholders to translate requirements into scalable data solutions
- Provide technical guidance and mentoring to junior engineers
Required Skills & Expertise
Microsoft Azure & Fabric
- Microsoft Fabric (Data Pipelines Lakehouse Warehouse OneLake)
- Azure Data Factory (ADF)
- Azure Data Lake Storage Gen2 (ADLS G2)
- Azure Blob Storage
Programming & Query Languages
- SQL (Basic & Advanced)
- TSQL
- Stored Procedures
- Python
- PySpark / Spark SQL
Data Engineering & Architecture
- ETL / ELT Fundamentals
- Modern Data Platform Concepts
- Data Warehousing & Lakehouse Architecture
- Data Modeling Fundamentals (Star / Snowflake schemas)
- Incremental loads CDC and watermarking techniques
Monitoring & Governance
- Pipeline monitoring & performance optimization
- Azure Monitoring / Fabric monitoring tools
- Microsoft Purview (Data lineage & governance good to have)
Good to Have
- Experience with streaming or near realtime processing
- Exposure to Databricks in hybrid AzureFabric environments
- CI/CD for data pipelines using Git / Azure DevOps
- Experience supporting enterprisescale analytics platforms
Soft Skills
- Strong problemsolving and analytical mindset
- Excellent communication and stakeholder management skills
- Ability to work independently in fastpaced delivery environments
- Ownership mindset with focus on quality and reliability
Why Join Us
- Work on cuttingedge Azure & Microsoft Fabric implementations
- Exposure to largescale enterprise modernization programs
- Growth opportunities across cloud data platforms and analytics
- Collaborative highimpact engineering culture
We may use artificial intelligence (AI) tools to support parts of the hiring process such as reviewing applications analyzing resumes or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed please contact us.
Required Experience:
IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Brillio is a global leader in Enterprise Digital Transformation Solutions, providing strategic consulting services and solutions using emerging technologies.
