Data Architect (Managed Services)

ROLE OVERVIEW

We are looking for a seasoned Data Architect with deep expertise in enterprise data warehousing ETL/ELT pipeline development and business intelligence. You will be responsible for the end-to-end design and implementation of our data architecture from data ingestion and cleansing to dimensional modeling warehouse construction and BI dashboard delivery. You will also establish robust data governance frameworks including data catalogs lineage tracking and security audit systems. This role requires strong hands-on capability combined with architectural vision and prior experience in complex industries such as finance international trade or manufacturing is highly valued.

KEY RESPONSIBILITIES

Data Acquisition Cleansing & Integration

• Design and implement enterprise-wide data collection strategies across heterogeneous source systems (ETRM ERP CRM external APIs flat files and databases).
• Develop robust data cleansing and standardization pipelines to ensure data accuracy consistency and completeness across all data sources.
• Build data integration frameworks to consolidate data from disparate systems into a unified enterprise data warehouse handling schema evolution and data drift.
• Implement Change Data Capture (CDC) mechanisms and incremental data loading strategies to ensure near real-time data freshness.

Data Warehouse Architecture & Modeling

• Lead the design and construction of the enterprise data warehouse (EDW) using industry-proven methodologies (Inmon Kimball or Data Vault).
• Apply dimensional modeling expertise to design star schemas snowflake schemas and constellation models optimized for analytical query performance.
• architect data marts for specific business domains (finance sales supply chain operations) with clear separation of concerns.
• Select and implement appropriate data warehouse technologies based on workload characteristics: batch analytics (Hive Spark SQL) real-time analytics (ClickHouse Apache Doris StarRocks) or MPP databases (Greenplum Vertica).
• Design layered data architectures (ODS DWD DWS ADS / Bronze Silver Gold) with clear data flow and transformation logic at each layer.

ETL/ELT Pipeline Development

• Design build and maintain scalable ETL/ELT pipelines using Apache Spark Flink Hive MapReduce or proprietary ETL tools (Informatica Talend Kettle).
• Implement workflow orchestration using Apache Airflow DolphinScheduler Azkaban or Oozie to schedule monitor and manage data pipelines.
• Establish data quality frameworks: automated validation rules anomaly detection data profiling and quality scorecards to ensure pipeline reliability and data trustworthiness.
• Build comprehensive monitoring and alerting systems for pipeline health data freshness and SLA compliance.
• Optimize pipeline performance through partitioning bucketing indexing and query tuning strategies.

Business Intelligence & Reporting

• Develop enterprise BI reporting systems and interactive dashboards using tools such as Apache Superset FineBI Tableau Power BI or Quick BI.
• Design executive dashboards operational reports and self-service analytics interfaces tailored to business stakeholders across finance trading operations and management.
• Implement metrics frameworks (KPIs OKRs) and ensure data definitions are standardized documented and consistently applied across all reports.
• Work directly with business units to understand analytical requirements and translate them into effective data models and visualizations.

Data Governance & Standards

• Design and implement enterprise data governance frameworks from the ground up including data ownership policies stewardship roles and governance workflows.
• Build a centralized data catalog (using Apache Atlas DataHub Amundsen or similar) documenting all data assets business glossaries and metadata.
• Implement data lineage analysis systems to track data flow from source to consumption enabling impact analysis and root cause diagnosis.
• Establish data security and audit frameworks: access control (RBAC/ABAC) data masking encryption policies sensitive data discovery and compliance audit trails.
• Define and enforce data standards: naming conventions data dictionaries master data management (MDM) rules and data quality SLAs.
• Ensure regulatory compliance with data protection laws (GDPR PIPL industry-specific regulations) through governance controls and documentation.

REQUIRED QUALIFICATIONS

• Bachelors degree or above in Computer Science Statistics Mathematics Information Systems or related technical field.
• 3 years of professional experience in data development data engineering or data architecture roles with a proven track record of building production data warehouse systems.
• Expert-level proficiency in SQL (complex queries window functions CTEs query optimization) and Python for data processing and pipeline development.
• Mastery of data warehouse modeling theories and methodologies: dimensional modeling (Kimball) normalized modeling (Inmon) and Data Vault 2.0. Demonstrated experience designing star schemas snowflake schemas and aggregate tables for complex business domains.
• Deep domain experience in at least one complex industry: financial services (banking securities insurance) international trade (import/export supply chain logistics) or manufacturing (production planning quality control industrial IoT). Understanding of industry-specific data entities business processes and analytical requirements.
• Strong hands-on experience with ETL/ELT tools and frameworks: Apache Spark (batch and streaming) Apache Flink Hive MapReduce Sqoop DataX SeaTunnel or commercial ETL platforms (Informatica PowerCenter Talend IBM DataStage).
• Proficiency in workflow orchestration: Apache Airflow DolphinScheduler Azkaban Oozie or equivalent scheduling and monitoring platforms.
• Production experience with at least one major data warehouse/analytics database: ClickHouse Apache Doris StarRocks Hive Greenplum Vertica Teradata or Snowflake.
• Strong hands-on experience with BI and visualization tools: Apache Superset FineBI Tableau Power BI Quick BI or similar enterprise BI platforms.
• Deep expertise in Data Governance with demonstrated ability to build governance systems from scratch: data catalog implementation metadata management automated lineage tracking (using OpenLineage Marquez or similar) data quality monitoring and security audit frameworks.
• Solid understanding of relational and analytical databases: PostgreSQL MySQL Oracle SQL Server Greenplum including performance tuning indexing strategies and query optimization.
• Experience with big data ecosystem components: HDFS YARN ZooKeeper Kafka and Hadoop distributions (CDH HDP Apache).

PREFERRED QUALIFICATIONS

• Experience with master data management (MDM) platforms and methodologies.
• Familiarity with data mesh or data fabric architectural patterns for large-scale decentralized data environments.
• Experience with data versioning and time-travel capabilities in modern data warehouses.
• Domain knowledge on Energy Trading Market Risk Management.
• Professional certifications: CDMP (Certified Data Management Professional) DAMA-DMBOK or vendor-specific data platform certifications.