Senior Software Engineer — Backend (Files Team)

At Databricks we are passionate about enabling data teams to solve the worlds toughest problems from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the worlds best Data Intelligence Platform so our customers can use deep data insights to improve their business. Founded by engineers and customer obsessed we leap at every opportunity to tackle technical challenges from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And were only getting started.

The filesystem has emerged as the preferred runtime interface for agentic AI. AI agents use the filesystem for context memory management artifact (dashboard code etc) authoring version control sandboxing and interacting between systems and agents. It is the foundational layer to accelerate AI adoption

As a Senior Software Engineer on the Files team you will innovate at the intersection of storage performance and distributed systems directly shaping our filesystem strategy to power next-generation agentic workloads.

• Design build and operate the the filesystem platform powering tens of thousands of data AI and agentic workloads daily
• Push filesystem performance for the most demanding workloads profiling and optimizing across the stack from the API layer down to the Linux kernel
• Partner with teams across the platform to design and evolve next-generation compute and storage architectures
• Set the technical direction for how content is organized across Databricks standardizing around filesystem primitives that apply to every product surface

• Bachelors degree (or higher) in Computer Science or a related field
• 5 years of production-level experience in Java Scala C Go Rust or a similar language
• 3 years of experience developing large-scale distributed systems
• Experience with Kubernetes Docker or MicroVM technologies (e.g. Firecracker) and a strong grasp of cloud provider internals (AWS/Azure/GCP).
• You arent just a user of tools; you understand how to build them from the ground up when existing solutions fail at our scale.
• Experience with filesystems and FUSE
• Experience building object/blob storage (S3 Azure Blob Storage GCS etc)
• Systems performance engineering across microservices down to the Linux level
• Background in high-scale content storage or file-sync products