Senior Machine Learning Systems Engineer

Atlassians can choose where they work whether in an office from home or a combination of the two. That way Atlassians have more control over supporting their family personal goals and other priorities. We can hire people in any country where we have a legal entity.

Our organization is dedicated to driving AI innovation across all Atlassian products and platforms. We aim to deliver seamless AI experiences while establishing a robust Atlassian AI infrastructure for the future. Our purpose is to:

• Develop horizontal AI capabilities and infrastructure that can be leveraged across all products.

• Establish a centralized Search Q&A and Conversational AI system that integrates seamlessly with all Atlassian products.

• Explore integrating Atlassian products with AI solutions beyond the Atlassian ecosystem.

• Our teams goal is to build the foundations to democratize AI and Machine Learning for Atlassians teams customers and ecosystem. We aim to build productive reliable tools that empower Atlassian teams to harness AI. These tools will facilitate the development deployment measurement and operation of AI & ML models and experiences.

As a Senior ML System Engineer on the AI & ML Platforms Inference team you will design and optimize large-scale model serving systems end-to-end. You will own everything from distributed infrastructure (global KV cache continuous batching load balancing auto-scaling) to deep low-level optimizations (GPU kernels quantization speculative decoding).In this role you are expected to:

• Architect and implement scalable distributed infrastructure for model serving (load balancing auto-scaling batch scheduling global KV cache).

• Optimize latency and throughput of model inference under real production workloads.

• Build reliable high-concurrency serving systems that serve billions of requests reliably

• Benchmark fine-tune and accelerate inference engines.

• Create robust CI/CD infrastructure for seamless model deployment and inference engine updates.

• Partner with senior ML engineers to finetune open-source LLMs and deploy

Compensation

At Atlassian we strive to design equitable explainable and competitive compensation programs. We follow consistent hiring practices and account for each candidates skills knowledge and experience when setting base pay within the range. Please visit for more information on which locations are included in each of our geographic pay zones. However please confirm the zone for your specific location with your role may also be eligible for benefits bonuses commissions and equity.

In The United States we have three geographic pay zones. For this role our current base pay ranges for new hires in each zone are:

Zone A: $206100 - $269075

Zone B: $185490 - $242168

Zone C: $171063 - $223332

On your first day well expect you to have

• 5 years of software engineering experience 2 years of system performance optimization experience

• Deep low-level systems programming (C/C or Rust)

• Experience with large-scale high-concurrent production serving.

• Experience with GPU inference engines (vLLM SGLang Triton TensorRT-LLM etc.).

• Strong background in system optimizations: batching caching load balancing parallelism.

It would be great but not required if you have

• Low-level inference optimizations: GPU kernels

• Algorithmic inference optimizations: quantization speculative decoding distillation

• Experience with testing benchmarking and reliability of inference services.

• Experience designing and implementing CI/CD infrastructure for inference.

Benefits & Perks

Atlassian offers a wide range of perks and benefits designed to support you your family and to help you engage with your local community. Our offerings include health and wellbeing resources paid volunteer days and so much more. To learn more visit

Atlassian

At Atlassian were motivated by a common goal: to unleash the potential of every team. Our software products help teams all over the planet and our solutions are designed for all types of work. Team collaboration through our tools makes what may be impossible alone possible together.

We believe that the unique contributions of all Atlassians create our success. To ensure that our products and culture continue to incorporate everyones perspectives and experience we never discriminate based on race religion national origin gender identity or expression sexual orientation age or marital veteran or disability status. All your information will be kept confidential according to EEO provide you the best experience we can support with accommodations or adjustments at any stage of the recruitment process. Simply inform our Recruitment team during your conversation with them.

To learn more about our culture and hiring process visit In line with local law identity verification (which may include use of biometric data) is a condition of employment with Atlassian for employment fraud purposes.