Data Engineer

Seeking a motivated career and customer-oriented Data Engineer to join our Partners team in Herndon VA. The Data Engineer will leverage their expertise with Python to support the customers data pipelines and related applications from collection to ingestion and ensure the integrity and security of data systems. You will play a critical role in delivering relevant and actionable cyber data to the right customers in a format that is normalized and actionable by cyber analysts and data scientists.

Responsibilities

• Design build optimize and maintain resilient data pipelines using Python with a focus on data collection ingestion ETL and analytics
• Develop and support complex data solutions including data transformation validation and quality controls
• Integrate data from a variety of internal and external sources including REST APIs flat files and structured/semi-structured formats
• Ensure data is available accessible reliable and securely handled to meet stakeholder and operational needs
• Test troubleshoot and validate data movement parsing and transformation code across development and production environments
• Provide platform and production support including debugging root cause analysis issue resolution and ongoing maintenance
• Collaborate with cross-functional teams to deliver data products and help end users understand and effectively use analytics environments

Requirements

• TS/SCI FSP Clearance
• High School Diploma and 5 years experience with software development in Python
• 15 years of overall experience
• Experience with data engineering
• Experience building and maintaining data pipelines ETL processes and ingestion workflows
• Experience with Git/GitHub or similar version control systems
• Experience with common data formats such as JSON XML CSV and other structured or semi-structured data
• Experience working with Bash Linux and command-line tools in a development or production environment

About Us
For more than 20 years NewGen Technologies has solved our clients toughest IT challenges with integrity security and outstanding service by delivering both technology and talent. We have helped secure borders have used artificial intelligence (AI) to fight terror aided the identification of criminals and have helped to prevent crime through the introduction of team of Highly Cleared Specialists have hard-to-find skills and expertise in a wide spectrum of technologies to provide solutions that transform business processes and solve problems of national significance. #CJ