Full-Stack Data Engineer

Prescient Edge is seeking aFull-Stack Data Engineer to support a Federal Government client.

Please note that the availability of this position is contingent upon contract award.

Benefits:

AtPrescientEdge we believe that acting with integrity and serving our employees is the key to everyones success. To that end we provide employees with a best-in-class benefits package that includes:

• A competitive salary with performance bonus opportunities.
• Comprehensive healthcare benefits including medical vision dental and orthodontia coverage.
• A substantial retirement plan with no vesting schedule.
• Career development opportunities including on-the-job training tuition reimbursement and networking.
• A positive work environment where employees are respected supported and engaged.

Description:

• Proposed personnel possess the knowledge and capability to develop maintain and optimize an outward-facing data catalog that integrates geospatial and research data layers.
• Optimize data integration pipelines API services and front-end interfaces for accessing and visualizing geospatial and structured data.
• Must be proficient in full-stack development database architecture and API integration to enable seamless search filtering and rendering of structured research products.
• Must be proficient in Data Lakes splat forms such as Databricks Kubernetes ESRI ArcGIS environments and cloud based data engineering.
• Expertise in building scalable secure web applications implementing metadata-driven search and retrieval features and integrating APIs for seamless data interoperability is required.
• Shall establish and maintain metadata governance frameworks ensuring compliance with DoD data management policies and interoperability with a Data Catalog.
• Shall develop automated metadata tagging processes to improve data discoverability classification and lineage tracking within the Common Intelligence Picture (CIP) platform.
• Shall implement and manage data governance workflows ensuring integration with Open Lineage Unity Catalog and GIS metadata standards.
• Shall submit the Metadata & Data Governance Compliance Report detailing lineage tracking classification policies and security enhancements.
• Shall develop and maintain the data pipeline infrastructure ensuring scalable ingestion transformation and integration of structured and unstructured datasets within the cloud-based CIP platform.
• Shall optimize data storage strategies implementing efficient query execution indexing and retrieval techniques for high-volume mission datasets.
• Shall integrate APIs for secure data sharing across operational environments ensuring controlled access and compliance with security frameworks.
• Shall submit the Data Pipeline Optimization Report detailing improvements in ingestion speed storage efficiency and API integrations.

Experience:

• Must have demonstrated experience in developing interactive web-based data portals implementing API driven data exchange and integrating geospatial data layers into web applications.
• Must have experience working with Databricks ESRI ArcGIS Feature Services Open Lineage and metadata management solutions is required.
• Must have demonstrated experience in: Developing and deploying full-stack applications that enable data visualization dashboarding and analytics within ESRI based GIS platforms Unity Catalog and cloud-based databases.
• Implementing RESTful and GraphQL APIs for seamless data retrieval and integration between Data Lake ESRI ArcGIS and external sources.
• Managing CI/CD pipelines containerized deployments in Kubernetes and API authentication mechanisms to ensure secure access to research products.
• Optimizing database queries and indexing strategies for large-scale geospatial and structured datasets.
• Desirable but not required certifications include Microsoft Certified: Azure Data Engineer Associate AWS Certified Data Analytics Specialty or ESRI Web GIS Developer Certification.

Education:

• Bachelors degree in computer science Data Engineering Geospatial Information Systems (GIS) or a related field or five (5) years of equivalent experience in data engineering full-stack development and metadata-driven data cataloging.

Security clearance:

• TS/SCI

Location:

• Doral Florida. (USSOUTHCOM Headquarters)