Senior Data Engineer

About TaskUs: TaskUs is a provider of outsourced digital services and next-generation customer experience to fast-growing technology companies helping its clients represent protect and grow their brands. Leveraging a cloud-based infrastructure TaskUs serves clients in the fastest-growing sectors including social media e-commerce gaming streaming media food delivery ride-sharing HiTech FinTech and HealthTech.

The People First culture at TaskUs has enabled the company to expand its workforce to approximately 45000 employees globally. Presently we have a presence in twenty-three locations across twelve countries which include the Philippines India and the United States.

It started with one ridiculously good idea to create a different breed of Business Processing Outsourcing (BPO)! We at TaskUs understand that achieving growth for our partners requires a culture of constant motion exploring new technologies being ready to handle any challenge at a moments notice and mastering consistency in an ever-changing world.

What We Offer: At TaskUs we prioritize our employees well-being by offering competitive industry salaries and comprehensive benefits packages. Our commitment to a People First culture is reflected in the various departments we have established including Total Rewards Wellness HR and Diversity. We take pride in our inclusive environment and positive impact on the community. Moreover we actively encourage internal mobility and professional growth at all stages of an employees career within TaskUs. Join our team today and experience firsthand our dedication to supporting People First.

The Mission:As a Senior Data Engineer you are the engine room of our data strategy. You dont just move data; you build resilient self-healing systems that transform raw into high-fidelity data products. You will take the Architects blueprints and turn them into production-grade code ensuring there is clean and reliable data.

Work Mode: Remote

What the Senior Data Engineer will own:

• Pipeline Engineering:Build and maintain high-throughput ETL/ELT pipelines that ingest data from various sources into our Lakehouse.

• Code Quality & Tooling:Drive the adoption ofdbtfor transformation andPySparkfor heavy lifting. You will be responsible for writing modular reusable code that follows strict CI/CD practices.

• Observability & Reliability:Implement Data SLAs. You will build the monitoring and alerting systems that notify the team of data drift or pipeline failuresbeforethe business notices.

• Data Productization:Work closely with the BI team and Data Scientists to prepare feature-ready datasets.

• Performance Tuning:Deep-dive into SQL and Spark query plans to optimize slow-running jobs reducing cost and latency.

• Local Development Advocacy:Implementing a workflow where engineers can develop and test complex SQL transformations locally using DuckDB drastically reducing waiting-for-cluster time and lowering development costs.

• Cost-Efficient Micro-Pipelines:Building specialized pipelines for specific client reporting or data-quality checks that run on single-node containers (e.g. Lambda or small ECS tasks) using DuckDB avoiding the minimum billing cycles of larger warehouses.

• Embedded Analytics:Exploring ways to use DuckDB as an embedded engine for internal tools or edge processing within the BPOs local site offices where bandwidth to the cloud might be a constraint.

Technical Skills & Experience:

• 5 Years in Data Engineering:Youve lived through the on-call life and know how to build systems that dont break at 3 AM.

• The Power Trio:Expert-level proficiency inPythonSQL andPySpark.

• Modern Lakehouse Stack:Hands-on experience withDatabricks(Delta Lake) orSnowflake. You understand the nuances of theMedallion Architecture(Bronze/Silver/Gold).

• Transformation & Modeling:Advanced experience withdbt (Data Build Tool). You treat data models like software including version control testing and documentation.

• Orchestration:Experience withApache Airflowor Prefect specifically building complex idempotent DAGs.

• Streaming Experience:Familiarity withKafkaKinesis or Spark Streaming is a huge plusour BPO operations move in real-time.

• Infrastructure as Code (IaC):Comfort withTerraformor CloudFormation to manage your own data infrastructure.

• In-Process Analytics (DuckDB):Proven experience using DuckDB for high-speed local development unit testing data transformations or as a query engine for small-to-medium datasets (up to 100GB) without the overhead of a distributed cluster.

• Hybrid Execution Patterns:Ability to identify when to useheavyweight compute(PySpark/Databricks) versuslightweight compute(DuckDB/Python) to minimize cloud costs and reduce job latency.

• Parquet/Iceberg Interaction:Experience using DuckDB to directly query data stored in S3/Azure Blob (via Parquet or Iceberg files) for rapid ad-hoc analysis or local dashboarding.

• Orchestration: Kubernetes (K8s). Deep understanding of Pods Deployments Services ConfigMaps and Secrets management.

How We Partner To Protect You: TaskUs will neither solicit money from you during your application process nor require any form of payment in order to proceed with your application. Kindly ensure that you are always in communication with only authorized recruiters of TaskUs.

DEI: In TaskUs we believe that innovation and higher performance are brought by people from all walks of life. We welcome applicants of different backgrounds demographics and circumstances. Inclusive and equitable practices are our responsibility as a business. TaskUs is committed to providing equal access to opportunities. If you need reasonable accommodations in any part of the hiring process please let us know.

We invite you to explore all TaskUs career opportunities and apply through the provided URL Experience:

Senior IC