AWS & Databricks Administrator

AWS & Databricks Administrator
Location: Santa Clara CA (Onsite)
Duration: 6-12 months (Contract)

Overview
We are seeking a highly skilled AWS & Databricks Administrator to architect manage and optimize enterprise cloud and data platforms. This role will focus on supporting SAP workloads on AWS governing Databricks architecture and ensuring secure scalable integrations across enterprise systems. The ideal candidate will bring deep expertise in AWS services Databricks administration Informatica platforms and containerized workloads with a strong emphasis on automation observability and operational resilience.
Key Responsibilities

• Architect and support AWS infrastructure for SAP workloads (S/4HANA BW/4HANA integrations storage networking identity backup HA/DR).
• Design and manage AWS services: VPC Transit Gateway EC2 EBS S3 IAM KMS Route 53 CloudWatch CloudTrail AWS Backup load balancers and security services.
• Define and govern Databricks architecture on AWS (workspace strategy network isolation Unity Catalog cluster policies orchestration cost optimization).
• Establish scalable data-lakehouse patterns using Delta Lake medallion architecture Spark Python SQL streaming and batch pipelines.
• Administer Informatica platforms (PowerCenter IDMC/IICS Data Quality MDM) including runtime environments repositories schedules upgrades and monitoring.
• Design secure integration patterns between SAP Informatica Databricks AWS services and downstream analytics/reporting systems.
• Build and maintain Git-based CI/CD pipelines for infrastructure Databricks assets Informatica deployments APIs and containerized workloads.
• Implement infrastructure-as-code using Terraform CloudFormation Pulumi or equivalent tools.
• Architect and support Amazon EKS clusters and containerized workloads using Docker Kubernetes Helm Argo CD Flux or GitOps tooling.
• Establish DevSecOps controls: code scanning dependency scanning container-image scanning secrets management RBAC encryption and audit logging.
• Implement observability with centralized logs metrics alerts dashboards and tracing (CloudWatch Prometheus Grafana ELK/OpenSearch Datadog Splunk).
• Lead production support for high-severity incidents conduct RCA and improve operational runbooks.
• Define standards for availability resilience patching release management change controls capacity planning performance tuning and cost optimization.
• Mentor engineering teams conduct architecture reviews and communicate technical decisions to leadership.

Required Skills:

AWSSAPDATABRICKS