Senior Software Engineer, Compute Infrastructure

RDQ427R198

Multi-cloud is core to Databricks product strategy. Compute serves as the layer that abstracts the cloud from the rest of the company. Building unified infrastructure on top of heterogeneous clouds is a challenge that few companies experience.

As an engineer on this team you wont just manage infrastructure; you will build it as a product. You will tackle the hard problems of distributed systems: sub-second container/MicroVM startup times multi-tenant security isolation and building a unified orchestration layer that scales across AWS Azure and GCP.

• Design and build the next generation of our Serverless platform focusing on high availability low latency and scale-to-zero efficiency.
• Build a single compute stack that supports heterogeneous workloads including GPU instance qualification for AI training and stateful execution for Lakebase.
• Solve Multi-Cloud Complexity: Develop platform-level abstractions that allow Databricks to run seamlessly across all major cloud providers.
• Optimize everything from the API gateway down to the host-level networking and container orchestration.
• Work alongside industry experts who have built world-class systems like Borg Kubernetes and Ubers infrastructure.

• 5 years of production-level experience in one of: Python Java Scala C or a similar language
• 4 years of experience developing large-scale distributed systems from scratch
• Experience with Kubernetes Docker or MicroVM technologies (e.g. Firecracker) and a strong grasp of cloud provider internals (AWS/Azure/GCP).
• You arent just a user of tools; you understand how to build them from the ground up when existing solutions fail at our scale.