Data Engineer

Leidos is seeking a Data Engineer to support the National Healthcare Safety Network (NHSN) support contract on a strategic modernization initiative to migrate SAS datasets ETL processes and analytical workloads to the Databricks Lakehouse Platform. This role will be responsible for converting legacy SAS data processing into scalable PySpark and SparkR solutions while ensuring data integrity performance and business rule consistency.

The ideal candidate has experience with both SAS and modern distributed data processing frameworks and can translate complex SAS workflows into optimized Databricks implementations.

Primary Responsibilities:

• Migration of SAS datasets ETL workflows and data transformation logic to Databricks.
• Convert SAS programs DATA steps PROC SQL and macros into PySpark and SparkR code.
• Develop scalable data pipelines using Apache Spark within the Databricks environment.
• Design and optimize Delta Lake tables for performance reliability and scalability.
• Validate migrated datasets through automated reconciliation and data quality testing.
• Partner with business analysts data scientists and application teams to ensure functional equivalence between SAS and Databricks solutions.
• Optimize Spark jobs for performance partitioning and resource utilization.
• Develop reusable frameworks utilities and coding standards to accelerate migration efforts.
• Document data lineage transformation logic and technical designs.
• Participate in code reviews and implement CI/CD practices using Git and Azure DevOps (or similar tools).

Required Qualifications:

• Bachelors degree in Computer Science Information Technology Engineering Mathematics or a related discipline.
• 5 years of experience in Data Engineering or ETL development.
• Strong experience developing with SAS (Base SAS DATA Step PROC SQL SAS Macros).
• Hands-on experience with Databricks.
• Strong proficiency in PySpark and/or SparkR.
• Advanced SQL development skills.
• Experience with Delta Lake architecture and Spark optimization techniques.
• Experience building and maintaining enterprise-scale data pipelines.
• Knowledge of data modeling data warehousing and distributed computing principles.
• Experience with Git and CI/CD deployment processes.

Preferred Qualifications:

• Previous experience leading enterprise SAS modernization initiatives.
• Experience migrating SAS datasets and business logic to Databricks.
• Experience with Unity Catalog Delta Live Tables and Databricks Workflows.
• Familiarity with Azure Data Factory Azure Synapse or other cloud-native data integration services.
• Experience working with large-scale healthcare insurance or financial datasets.
• Knowledge of data governance security and regulatory compliance requirements.
• Experience implementing automated testing and data validation frameworks.

If youre looking for comfort keep scrolling. At Leidos we outthink outbuild and outpace the status quo because the mission demands it. Were not hiring followers. Were recruiting the ones who disrupt provoke and refuse to fail. Step 10 is ancient history. Were already at step 30 and moving faster than anyone else dares.

Original Posting:

Pay Range:

The Leidos pay range for this job level is a general guideline onlyand not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job education experience knowledge skills and abilities as well as internal equity alignment with market data applicable bargaining agreement (if any) or other law.