The Palantir Data Engineer leverages advanced Python skills within a small team to develop and implement data transformation pipelines in Palantirs environment. They will be responsible for all workflows configuration and management of a Palantir-based application. The Data Engineer will also integrate with external systems via API parse API responses into usable data objects design user interfaces and develop custom functions with TypeScript. Data Engineer will conduct code reviews solution brainstorming and define UI designs and functionalities. Successful candidate must be able to perform tier 2 level triage with customers and translate concerns into specific requirements. Ability to effectively triage requirements and articulate impacts on the existing environment is critical to mission success. Data Engineer will also develop new tools code and services to execute data engineering activities involving data of varying types and in varying conditions.
Responsibilities
Movement of structure and unstructured data using approved methods
Execute data ingestion activities for storing data in a local or enterprise level location
Develop code to format data that supports exploration
Analyze source data formats and work with Data Scientists and partners to determine the formats and transforms that best meet mission objective
Develop code and tools to provide one-time and on-going data extraction from various repositories formatting and transformations into enterprise or standalone data models
Develop new ETL and perform O&M and enhancements on existing ETL code using best practices/standards
Develop and deliver documentation for each project including ETL mappings code use guide code locationand access instructions
Defineand implementcomplex data workflows for analytic systems
Managedata retention policies to include performing data deletion
ManageUSP data within the IC under Cl authorities
Requirements
TS/SCI FSP Clearance
Minimum of 3-5 years experience with:
Python
PalantirFoundry
PalantirPipeline Builder
PalantirWorkshop
Typescript
Proficiency with programming languages such as Java C Python JavaScript or similar languages
Understanding of XML YAML and JSON files and their roles within a system
Familiarity with data structures storage systems cloud infrastructure front-end frameworks and other technical tools as well as an understanding of how technical decisions impact the user of what youre building
About Us For more than 20 years NewGen Technologies has solved our clients toughest IT challenges with integrity security and outstanding service by delivering both technology and talent. We have helped secure borders have used artificial intelligence (AI) to fight terror aided the identification of criminals and have helped to prevent crime through the introduction of team of Highly Cleared Specialists have hard-to-find skills and expertise in a wide spectrum of technologies to provide solutions that transform business processes and solve problems of national significance. #CJ
Required Experience:
IC
The Palantir Data Engineer leverages advanced Python skills within a small team to develop and implement data transformation pipelines in Palantirs environment. They will be responsible for all workflows configuration and management of a Palantir-based application. The Data Engineer will also integr...
The Palantir Data Engineer leverages advanced Python skills within a small team to develop and implement data transformation pipelines in Palantirs environment. They will be responsible for all workflows configuration and management of a Palantir-based application. The Data Engineer will also integrate with external systems via API parse API responses into usable data objects design user interfaces and develop custom functions with TypeScript. Data Engineer will conduct code reviews solution brainstorming and define UI designs and functionalities. Successful candidate must be able to perform tier 2 level triage with customers and translate concerns into specific requirements. Ability to effectively triage requirements and articulate impacts on the existing environment is critical to mission success. Data Engineer will also develop new tools code and services to execute data engineering activities involving data of varying types and in varying conditions.
Responsibilities
Movement of structure and unstructured data using approved methods
Execute data ingestion activities for storing data in a local or enterprise level location
Develop code to format data that supports exploration
Analyze source data formats and work with Data Scientists and partners to determine the formats and transforms that best meet mission objective
Develop code and tools to provide one-time and on-going data extraction from various repositories formatting and transformations into enterprise or standalone data models
Develop new ETL and perform O&M and enhancements on existing ETL code using best practices/standards
Develop and deliver documentation for each project including ETL mappings code use guide code locationand access instructions
Defineand implementcomplex data workflows for analytic systems
Managedata retention policies to include performing data deletion
ManageUSP data within the IC under Cl authorities
Requirements
TS/SCI FSP Clearance
Minimum of 3-5 years experience with:
Python
PalantirFoundry
PalantirPipeline Builder
PalantirWorkshop
Typescript
Proficiency with programming languages such as Java C Python JavaScript or similar languages
Understanding of XML YAML and JSON files and their roles within a system
Familiarity with data structures storage systems cloud infrastructure front-end frameworks and other technical tools as well as an understanding of how technical decisions impact the user of what youre building
About Us For more than 20 years NewGen Technologies has solved our clients toughest IT challenges with integrity security and outstanding service by delivering both technology and talent. We have helped secure borders have used artificial intelligence (AI) to fight terror aided the identification of criminals and have helped to prevent crime through the introduction of team of Highly Cleared Specialists have hard-to-find skills and expertise in a wide spectrum of technologies to provide solutions that transform business processes and solve problems of national significance. #CJ
After a couple of years without an operating business, NewGen Technologies (formerly Bongiovi Entertainment) is once again revving its engines following a reverse merger with alternative fuel developer ReFuel America (which now functions as its operating subsidiary). The company hopes
... View more