RQ11713 Software Developer ETL Senior I Toronto Onsite I 1+year

RQ11713 - Software Developer - ETL - Senior

Organization: Central Agencies Cluster

Ministry: Ministry of Treasury Board Secretariat

Location: Toronto ON Onsite

Pay rate: 95-101/hr incorp

Title

Software Developer - ETL

Description

Role Overview

The Senior ETL Developer will design build and maintain scalable database backends data pipelines and Extract Transform Load (ETL) solutions supporting Enterprise Data Warehouse and Business Intelligence platforms.

Key Responsibilities

Pipeline Development: Design build and maintain initial and incremental (daily) ETL/ELT pipelines across structured and semi-structured datasets.

Architecture & Modeling: Implement scalable data architectures dimensional models data marts and warehouse repositories.

Code & Automation: Write modular code manage dependency scheduling logic and build data cleansing routines.

Performance Tuning: Optimize complex SQL queries and conduct database administration tasks.

Documentation: Produce source-to-target mapping documents data models and detailed technical specifications.

Support & Collaboration: Troubleshoot production pipeline defects participate in design walkthroughs and translate business requirements into technical deliverables.

Qualifications & Requirements

Mandatory Technical Skills

Microsoft Azure Stack: Azure Data Factory (ADF) Azure SQL Database Azure Data Lake Storage (ADLS) and Power BI.

Cloud & Big Data Platforms: Databricks AWS services (Amazon Aurora RDS AWS Glue OpenSearch).

ETL & Data Engineering: Advanced data extraction transformation data modeling cleansing and pipeline scheduling.

Databases & Querying: Relational and dimensional databases advanced SQL development and query optimization.

Source Control & SDLC: Full lifecycle development experience utilizing Git and standard branching strategies.

Nice-to-Have Skills

Application Development: Experience with C# REST APIs Azure Functions or microservices.

Scripting: Automation using PowerShell or similar scripting languages.

Reporting: Designing ad-hoc reports and executive KPI dashboards.

Compliance: Working knowledge of the Accessibility for Ontarians with Disabilities Act (AODA) standards.

Evaluation Criteria

CategoryCriteria BreakdownWeightCore Technical Skills Azure stack (ADF Azure SQL ADLS Power BI)
AWS ecosystem (Aurora RDS Glue OpenSearch)
End-to-end ETL design scheduling cleansing and analytics
Data warehousing modeling and administration
Complex SQL optimization and performance tuning
Source-to-target mapping and technical documentation50%Secondary Technical Skills Git source control strategies
End-to-end SDLC best practices
Application development (C# APIs Functions)
PowerShell scripting and automation
Dashboard and KPI report design35%Communication Skills Requirement elicitation stakeholder management and validation
Clear written documentation and technical communication10%Standards & Compliance Understanding of AODA standards and government IT guidelines5%Total Score100%