Senior Backend Engineer (CDP Engineering)
Job Location:
Frisco, TX - USA
Monthly Salary:
Not Disclosed
Posted on:
23 hours ago
Vacancies:
1 Vacancy
Job Summary
Mandatory Areas: Senior Backend Engineer with Audience Builder Platform and CDP
Must have Skills Java API Kafka CDP
Skill 1 7Yrs of Exp Cassandra DynamoDB ScyllaDB
Skill 2 7Yrs of Exp MongoDB and PostgreSQL
Skill 3 5Yrs of Exp in IT
Role: Senior Backend Engineer (Audience Builder Platform - Customer Data Platform Engineering)
KEY RESPONSIBILITIES
CDP Customer Profile Platform
Design and operate the unified customer profile layer - the core of client CDP - supporting 400M profiles with high-throughput ingestion identity resolution and real-time enrichment.
Architect and build scalable customer profile services supporting 400M profiles with sub-second access patterns
Implement identity resolution and profile stitching across first-party and third-party data sources - a critical CDP capability
Support high-volume batch ingestion incremental processing and near real-time profile updates driven by behavioral events
Evaluate and implement storage technologies including Cassandra DynamoDB ScyllaDB MongoDB and PostgreSQL for distinct workload profiles
Build attribute enrichment pipelines that continuously improve profile completeness and accuracy
Implement data governance controls including consent management data suppression and regulatory compliance hooks (CCPA TCPA)
Real-Time Data Ingestion & Event Processing
Build the event-driven infrastructure that keeps customer profiles synchronized with whats happening right now - the heartbeat of a modern CDP.
Design and build event-driven architectures using Kafka and event streaming platforms for real-time profile updates
Implement change data capture (CDC) pipelines to propagate updates from source systems into the CDP profile store
Build data synchronization services supporting multi-source fan-in and downstream fan-out to activation channels
Implement dead-letter queues retry strategies and failure recovery for mission-critical data pipelines
Ensure event ordering guarantees and exactly-once processing semantics where required
Audience Segmentation Engine
Build the high-performance segmentation engine that enables marketers to define and generate audiences of any complexity at scale.
Design and build an audience generation service capable of evaluating complex nested filter logic across 400M profiles
Support attribute-based filtering hierarchical attribute traversal AND/OR conditional logic inclusion and exclusion criteria
Implement dynamic audience generation with real-time estimation to support pre-activation reach planning
Optimize query execution using columnar storage pre-aggregation and intelligent caching strategies
Build audience snapshot and version management to support reproducibility and campaign history
Integrate with the CDP profile store to ensure segmentation reflects the most current available profile state
Campaign Management & Lifecycle Services
Build the durable consistent services that manage campaign definitions from creation through execution.
Develop APIs for campaign creation versioning configuration approval scheduling and lifecycle transitions
Persist campaign definitions segmentation rules targeting criteria and execution metadata with full audit support
Implement campaign versioning and change tracking to support rollback comparison and governance requirements
Build approval workflow services supporting configurable multi-stage review before campaign activation
Analytics & Audience Insights
Build the analytical layer that gives users visibility into audience composition campaign reach and performance - a defining capability of enterprise CDPs.
Build services providing real-time audience size estimation reachability calculations and channel eligibility analysis
Implement segment distribution analytics - demographic breakdowns attribute frequency distributions overlap analysis
Support both real-time query serving and scheduled batch analytical workloads
Build historical campaign reporting infrastructure for performance analysis and optimization feedback loops
Expose analytical APIs that the UI layer can leverage for interactive exploration
Activation & Multi-Channel Delivery
Implement the delivery layer that gets audience segments into activation channels reliably and at scale.
Build file-based delivery to Amazon S3 Azure Blob Storage and Google Cloud Storage for downstream consumption
Implement API-based delivery to internal and external partner systems via REST and event-based integrations
Build event-based delivery using Kafka topics Event Hubs and Pub/Sub systems
Implement delivery monitoring configurable retry policies and failure recovery with full observability
Support delivery SLAs with alerting and automated escalation for time-sensitive campaign activations
Campaign Execution Orchestration
Build the orchestration layer that reliably executes campaign activations on schedule and at scale.
Design and build an orchestration service supporting one-time recurring and scheduled campaign activations
Implement distributed scheduling with fault tolerance retry and idempotent execution guarantees
Build execution monitoring with real-time status tracking alerting and SLA enforcement
Support parallel execution across large audience segments with configurable concurrency and rate limiting
Security Multi-Tenancy & Governance
Implement Role-Based Access Control (RBAC) with fine-grained permissions at workspace campaign and data levels
Build multi-workspace architecture with strict data isolation and cross-workspace access controls
Implement audit logging for all data access mutation events and system actions
Integrate data governance controls supporting consent flags data suppression lists and regulatory requirements
Build security monitoring and anomaly detection for sensitive customer data access patterns
Platform Reliability & Observability
Build observability solutions including metrics structured logging distributed tracing and alerting
Define and instrument SLIs SLOs and SLAs across all platform services
Implement capacity planning tooling and auto-scaling patterns for traffic variability
Conduct regular chaos engineering and failure mode analysis to improve platform resilience
TECHNICAL SKILLS
Languages Databases
Java / Kotlin (primary) Cassandra / ScyllaDB
Python DynamoDB
Go MongoDB
SQL PostgreSQL / Aurora
Scala (preferred) Redis / ElastiCache
Streaming & Messaging Cloud & Infrastructure
Apache Kafka AWS (primary)
Event Streaming Platforms Azure
Message Queues (SQS Pub/Sub) Google Cloud Platform
Change Data Capture (Debezium) Kubernetes / Docker
CI/CD Pipelines
Architecture Patterns Data & Observability
Microservices Architecture Spark / Flink (batch/stream)
Event-Driven Architecture dbt / Data Modeling
REST APIs / gRPC OpenTelemetry / Jaeger
Distributed Systems Prometheus / Grafana
PREFERRED QUALIFICATIONS
CDP & MARKETING TECHNOLOGY EXPERIENCE
Customer Data Platform (CDP) design and implementation at scale
Identity resolution profile unification and customer graph management
Real-time segment evaluation engines with sub-second SLAs
Consent management and data governance for regulatory compliance (CCPA TCPA GDPR)
Campaign Management System or Marketing Automation Platform engineering
Customer profile platforms supporting 100M profiles
PLATFORM & SYSTEMS EXPERIENCE
High-throughput distributed data ingestion pipelines (billions of events/day)
Large-scale key-value and wide-column store optimization
Streaming architecture patterns: CDC event sourcing CQRS
Multi-tenant SaaS platform design with strict data isolation
MLOps integration for propensity scoring and predictive audience generation