Data Developer
Job Location:
Charlotte, VT - USA
Monthly Salary:
Not Disclosed
Posted on:
Yesterday
Vacancies:
1 Vacancy
Job Summary
Title: Data Developer
Location: Charlotte NC 28202 (Hybrid)
Duration: 12 Months
Pay Rate: $55.00 - $62.00/- on W2
Kindly share your most updated resume.
Roles and Responsibilities:
Develops scripts processes and tools to ingest transform and deliver data in a MS Fabric environment to support analytics and reporting needs.
Lakehouse Architecture & Platform Engineering
Design build and maintain scalable lakehouse architecture in Microsoft Fabric and OneLake
Ensure high availability reliability and performance of data platforms
Data Pipelines & Ingestion
Build and maintain end-to-end data pipelines for ingestion transformation and serving
Develop scalable ingestion frameworks for batch and real-time sources (APIs databases event streams)
Integrate enterprise systems (Jira ERP CRM flat files streaming sources)
Data Processing & Transformation
Develop and execute large-scale Spark jobs (batch and streaming)
Author and maintain notebooks (PySpark SQL) for transformation and analysis
Implement data cleansing enrichment and transformation logic
Data Quality & Integration
Build ingestion logic for structured semi-structured and unstructured data
Implement data validation and quality controls
Data Enablement
Deliver analytics-ready datasets for Power BI and downstream consumption
Skill Requirements
Microsoft Fabric (Lakehouse OneLake Pipelines Notebooks)
Apache Spark (PySpark Spark SQL)
SQL
Python
Delta Lake / Delta Tables
Data Pipeline Design (ETL / ELT)
API & Streaming Data Integration
Lakehouse Architecture & Platform Engineering
Design build and maintain scalable lakehouse architecture in Microsoft Fabric and OneLake
Ensure high availability reliability and performance of data platforms
Data Pipelines & Ingestion
Build and maintain end-to-end data pipelines for ingestion transformation and serving
Develop scalable ingestion frameworks for batch and real-time sources (APIs databases event streams)
Integrate enterprise systems (Jira ERP CRM flat files streaming sources)
Data Processing & Transformation
Develop and execute large-scale Spark jobs (batch and streaming)
Author and maintain notebooks (PySpark SQL) for transformation and analysis
Implement data cleansing enrichment and transformation logic
Data Quality & Integration
Build ingestion logic for structured semi-structured and unstructured data
Implement data validation and quality controls
Data Enablement
Deliver analytics-ready datasets for Power BI and downstream consumption
Skill Requirements
Microsoft Fabric (Lakehouse OneLake Pipelines Notebooks)
Apache Spark (PySpark Spark SQL)
SQL
Python
Delta Lake / Delta Tables
Data Pipeline Design (ETL / ELT)
API & Streaming Data Integration