Senior Python Platform Engineer – PySpark FastAPI GCP
Job Location:
Charlotte, VT - USA
Monthly Salary:
Not provided by the employer
Posted:
19 September 2026 (6 hours ago)
Application Deadline:
17 December 2026
Vacancies:
1 Vacancy
Job Summary
Job Title: Senior Python Platform Engineer PySpark / FastAPI / GCP
Work Location & Reporting Address: Charlotte NC 28202 (Onsite-Hybrid. Local Candidates only!)
Must Have Skills:
Python
Pyspark
API
Microservices CI/CD
GCP
ETL
Nice to Have Skills:
ETL
Detailed Job Description:
At least 10 years of experience in IT industry.
We are seeking a Python-based platform engineer to design and build a containerized API layer that abstracts and governs interactions with Apache Spark through a well-defined API contract. This role focuses on building platform capabilities not simply consuming existing data toolsenabling consistent secure and scalable access to Spark-based data pipelines.
The ideal candidate has strong experience developing production-grade APIs in Python that interface with data frameworks or pipeline orchestration systems packaging services using containers (Docker/Kubernetes) and operating them as reusable platform services. A proven background in CI/CD automation using GitHub Actions is required along with solid software engineering practices around testing versioning and deployment.
Should have good hands-on experience in GCP skills. Should be able to interact coordinate with the client.
Should be able to manage offshore resources also.
Should be able to work with other onsite team members and client.
Tech Skills
Python
Pyspark
Experience building control planes
Design patterns
o Modular containerized services
o Asynchronous processing
o Job-based work queue execution
o Immutability and idempotency
o Metadata management
o Policy enforcement
o Semantic modeling
o Observability and telemetry
o Side effect capability injection
GCP
Testing
Functional testing
Behavioral testing
Languages
Python
Frameworks and Platforms
FastAPI
ARQ
Kubernetes
Pytest
Minimum Years of Experience:
10 years
Certifications Needed:
None
Work Location & Reporting Address: Charlotte NC 28202 (Onsite-Hybrid. Local Candidates only!)
Must Have Skills:
Python
Pyspark
API
Microservices CI/CD
GCP
ETL
Nice to Have Skills:
ETL
Detailed Job Description:
At least 10 years of experience in IT industry.
We are seeking a Python-based platform engineer to design and build a containerized API layer that abstracts and governs interactions with Apache Spark through a well-defined API contract. This role focuses on building platform capabilities not simply consuming existing data toolsenabling consistent secure and scalable access to Spark-based data pipelines.
The ideal candidate has strong experience developing production-grade APIs in Python that interface with data frameworks or pipeline orchestration systems packaging services using containers (Docker/Kubernetes) and operating them as reusable platform services. A proven background in CI/CD automation using GitHub Actions is required along with solid software engineering practices around testing versioning and deployment.
Should have good hands-on experience in GCP skills. Should be able to interact coordinate with the client.
Should be able to manage offshore resources also.
Should be able to work with other onsite team members and client.
Tech Skills
Python
Pyspark
Experience building control planes
Design patterns
o Modular containerized services
o Asynchronous processing
o Job-based work queue execution
o Immutability and idempotency
o Metadata management
o Policy enforcement
o Semantic modeling
o Observability and telemetry
o Side effect capability injection
GCP
Testing
Functional testing
Behavioral testing
Languages
Python
Frameworks and Platforms
FastAPI
ARQ
Kubernetes
Pytest
Minimum Years of Experience:
10 years
Certifications Needed:
None
Required Experience:
Senior IC