Data Engineer

Data Engineer

Richfield MN 55423 (Local - Hybrid 2 Days/Week)

12 Months Contract

Project Description:
You will be part of the Myads reporting team responsible for building the measurement reporting and insights platform that powers Ads and the broader Retail Media this role you will design develop and maintain scalable reliable and high-performance data solutions that enable advertisers merchants and internal teams to measure campaign performance and business impact.

As a Developer you will build and enhance data pipelines APIs and cloud-based services on Google Cloud Platform (GCP) while contributing to the architecture and implementation of measurement platforms. You will collaborate closely with Product Management Ads Engineering Analytics Data Science and other cross-functional teams to deliver high-quality solutions that meet business needs and support growth objectives. You will participate in the full software development lifecycle including design implementation testing deployment and ongoing optimization of data and measurement systems. This role is hybrid which means you will work some days on site at the clients location and some days virtually from home.

Position Summary/Job Description:
Hire an experienced Data Engineer to design build and maintain scalable batch/streaming data pipelines on Google Cloud. The role requires deep SQL expertise production grade orchestration with Apache Airflow (Cloud Composer) and strong Python for ELT/ETL with exposure to Postgres.

Skills Overview:
SQL (5 years)
Apache Airflow (Cloud Composer) (3 years)
GCP (BigQuery Dataflow Pub/Sub GCS Composer) (3 years)
Python (5 years)
Big Data (warehousing/processing concepts performance)(5 years)
Postgres (3)

Experience
Design develop and operate reliable data pipelines and DAGs using Apache Airflow/Cloud Composer for batch and near real time workflows.
Build ELT/ETL on GCP services (e.g. BigQuery Dataflow Pub/Sub Cloud Storage; Composer for orchestration); enforce coding testing and observability standards.
Write expert level SQL for modeling complex transformations windowing functions and performance tuning; own query efficiency and cost optimization.
Develop Python data components (operators hooks transforms) packaging and CI/CD for deployment to Composer/Dataflow.
Work with Big Data ecosystems and MPP warehouses; support data ingestion schema evolution and partitioning/clustering strategies.
Integrate Postgres sources/targets
Partner with product analytics and platform teams; uphold security compliance data quality (DQ checks SLAs) and documentation standards.

What are some preferred/nice to have skills the manager is looking for
Who has worked in ads domain.
Should be able to talk to stakeholders and understand the problem and solve it efficiently
Preventing data quality issues before they impact users.
Prioritizing projects and handling multiple requests.

Required Skills:

SQLAPACHEPYTHONGCPPOSTGRES