Senior Data Platform Engineer

CRDF Global is hiring a Senior Data Platform Engineer to own our enterprise data platform in Microsoft Fabric.

The role owns the platform end to end: the architecture and standards it runs on the pipelines and models built on top of it and the ongoing support of the teams that report from it. Scope will continue to expand as additional systems are brought in so this is a long-term ownership role rather than a one-time project.

• Own the architecture of CRDF Globals data platform in Microsoft Fabric including lakehouse structure workspace layout and bronze silver and gold layers.
• Set technical standards for the platform and review designs before they are implemented.
• Provide technical direction to others contributing to the platform and review their work against those standards.
• Establish source control environment strategy and deployment pipelines for Fabric artifacts so changes are repeatable and reviewable.
• Manage capacity performance and cost. Monitor pipeline reliability and set up alerting for failures and data freshness.
• Define platform security including workspace roles row-level security and sensitivity labeling.
• Operate and support the platform including issue triage root cause analysis and escalation.
• Maintain platform documentation runbooks and architecture decisions.

• Build operate and extend ingestion pipelines from Deltek Costpoint Salesforce Microsoft 365 and SharePoint Smartsheet Fluxx Concur and Formstack.
• Implement incremental loads and change tracking and reconcile loaded data against source systems.
• Handle API authentication rate limits schema drift and failure recovery so pipelines run unattended.

• Own the gold-layer models that reporting runs on including conformed dimensions for project contract award organization and employee.
• Establish common enterprise identifiers so financial program grant and CRM data can be joined reliably.
• Build and maintain the Power BI semantic models that sit on top of the platform.
• Document lineage data definitions and quality rules and implement automated data quality checks.

• Work directly with Finance Contracts Programs and Operations to define requirements and agree on shared data definitions.
• Add new sources models and features as business needs change.

Cultural Requirements:

Trust

o Must operate to the highest standards of ethics and integrity

o Be accountable for performance to goals and objective of the position as set by leadership

o Be a reliable member of the team that the organization can count on

Teamwork

o Treat all people in a respectful and supportive manner

o Work collaboratively with others

o Be flexible and adaptable to change

Communication

o Seeks to achieve shared understandings when communicating

o Actively listens to others

o Respects and encouraged diverse perspectives

o Shares information openly and willingly

• Minimum 8 years of professional experience in data engineering data platform engineering or enterprise data integration.
• Hands-on experience building and operating a cloud data platform such as Microsoft Fabric Azure Synapse Databricks or Snowflake.
• Strong SQL and Python or PySpark for data transformation.
• Experience designing lakehouse or dimensional data models including medallion architecture star schemas and slowly changing dimensions.
• Experience integrating ERP CRM or financial systems through APIs REST and JSON and incremental extract patterns.
• Experience with orchestration source control and CI/CD for data pipelines using Azure DevOps or GitHub Actions.
• Experience setting technical standards and reviewing the work of engineers or analysts who do not report to you.
• Experience working directly with finance or program staff to turn business questions into data models.
• Strong oral and written communication skills in both Arabic and English.

• Familiarity with Deltek Costpoint data structures and project accounting.
• Experience with the Salesforce data model and APIs.
• Power BI semantic modeling DAX and dataset performance tuning.
• Microsoft Purview or a comparable data catalog and governance tool.
• Azure Data Factory Synapse Logic Apps or Event Hubs.
• dbt or a similar transformation framework.
• Experience in a federal contracting or grant-funded environment.
• Microsoft certification DP-600 or DP-700.