Mid Level Data Engineer
Arlington, TX - USA
Job Summary
Redhorse is transforming how the Department of Defense (DoD) utilizes data and technology. We are seeking a proactiveMid-Level Data Engineerto join our team supporting the Office of the Under Secretary of Defense for Acquisition & Sustainment (OUSD(A&S)). In this role you will play a key part in advancing data-driven decision-making across the DoD by developing and optimizing robust data pipelines and analytics solutions that support critical national security initiatives. This position offers exceptional visibility and hands-on growth working within enterprise defense data environments.
- Ingest configure and transform structured semi-structured and unstructured datasets to meet mission partner and stakeholder requirements.
- Build automate and maintain scalable ETL/ELT pipelines supporting DevOps and rapid analytics delivery.
- Maintain data pipeline operations monitor environment health and implement automated performance optimization and cost-reduction practices.
- Work under general guidance to prototype new data capabilities evaluate emerging technologies and deploy end-to-end data solutions.
- Collaborate with cross-functional technical teams to troubleshoot pipeline bottlenecks optimize database structures and implement secure data retrieval methods.
- Implement and automate DoD Security Technical Implementation Guides (STIGs) across data systems to ensure strict compliance and system security.
- US citizenship with an active Department of War (DoW) Top Secret (TS) security clearance and access to Sensitive Compartmented Information (SCI).
- Bachelors degree in Computer Science Data Engineering Information Systems or a related STEM field with 3 years of data engineering experience (or Masters degree with 2 years of experience).
- Demonstrated experience developing ETL/ELT pipelines and processing large-scale data using big data frameworks such as Apache Spark.
- Practical experience working within cloud environments (e.g. AWS Microsoft Azure or MilCloud 2.0).
- Proficiency in core data engineering programming and querying languages (e.g. Python SQL or Scala).
- Familiarity with database architectures data modeling and automated configuration management.
- Familiarity with applying and maintaining DoD Security Technical Implementation Guides (STIGs).
We encourage all candidates who meet the basic requirements to apply even if you do not have any of the following experience:
- Hands-on experience developing data workflows usingDatabricks(e.g. Delta Lake Lakehouse architecture PySpark).
- Experience integrating data pipelines with business intelligence and data visualization platforms particularlyQlik(Qlik Sense or QlikView).
- Experience working within the DoDAdvanaData Environment.
- Familiarity with deploying and engineering data pipelines across classified networks and multiple security domains.
- Experience with CI/CD tools and version control systems such as GitLab Jira or Jenkins.
- Active Top Secret (TS) clearance with Sensitive Compartmented Information (SCI) eligibility.
Required Experience:
Manager
About Company
We’ve all been on your side of the table at some point in our careers, in uniform or government. That experience helps us understand your challenges in a…