Sr Databricks Engineer

Function

Were Hitachi Digital Services a global digital solutions and transformation business with a bold vision of our worlds potential. Were people-centric and here to power good. Every day we future-proof urban spaces conserve natural resources protect rainforests and save lives. This is a world where innovation technology and deep expertise come together to take our company and customers from whats now to whats next. We make it happen through the power of acceleration.

Imagine the sheer breadth of talent it takes to bring a better tomorrow closer to today. We dont expect you to fit every requirement your life experience character perspective and passion for achieving great things in the world are equally as important to us.

Role Summary
We are looking for a highly skilled Databricks Solution Architect to lead the design and implementation of scalable enterprise-grade data platforms using Databricks. The ideal candidate will combine strong technical expertise in data engineering and cloud platforms (AWS/Azure/GCP) with architectural leadership solution design capability and strong stakeholder engagement skills.

Key Responsibilities

1. Solution Architecture & Design
Design end-to-end data architectures using Databricks Lakehouse Platform.
Architect scalable ETL/ELT pipelines real-time streaming solutions and advanced analytics platforms.
Define data models storage strategies and integration patterns aligned with business and enterprise architecture standards.
Provide guidance on cluster configuration performance optimization cost management and workspace governance.

2. Technical Leadership
Lead technical discussions and design workshops with engineering teams and business stakeholders.
Provide best practices frameworks and reusable component designs for consistent delivery.
Perform code reviews and provide technical mentoring to data engineers and developers.

3. Stakeholder & Project Engagement
Collaborate with product owners business leaders and analytics teams to translate business requirements into scalable technical solutions.
Create and present solution proposals architectural diagrams and implementation strategies.
Support pre-sales or discovery phases with technical input when needed.

4. Data Governance Security & Compliance
Define and implement governance standards across Databricks workspaces (data lineage cataloging access control etc.).
Ensure compliance with regulatory and organizational security frameworks.
Implement best practices for monitoring auditing and data quality management.

5. Continuous Improvement & Innovation
Stay updated on Databricks features roadmap and industry trends.
Recommend improvements optimizations and modernization opportunities across the data ecosystem.
Evaluate integration of complementary technologies (Delta Live Tables MLflow Unity Catalog streaming frameworks etc.).

Required Skills & Experience
Technical Skills
Databricks Expertise: Strong hands-on experience with Databricks (clusters notebooks Delta Lake MLflow Unity Catalog).
Cloud Platforms: Experience with at least one cloud provider (AWS Azure GCP).
Data Engineering: Strong proficiency in Spark Python SQL and distributed data processing.
Architecture: Experience designing large-scale data solutions including ingestion transformation storage and analytics.
Streaming: Experience with streaming technologies (Structured Streaming Kafka Kinesis EventHub).
DevOps: CI/CD practices for data pipelines (Azure DevOps GitHub Actions Jenkins etc.).

Soft Skills
Strong communication skills with the ability to engage both technical and business teams.
Experience working in Agile environments.
Ability to simplify complex technical concepts for non-technical audiences.
Strong analytical problem-solving and decision-making abilities.

Preferred Qualifications
Databricks Certified Data Engineer Professional / Architect certification.
AWS/Azure/GCP cloud architect certifications.
Experience with BI tools (Tableau Power BI Looker).
Experience in machine learning workflows and ML operations.
Background in large-scale data modernization or cloud migration projects.

Why Join Us
Opportunity to lead high-impact data initiatives using cutting-edge Databricks capabilities.
Work with a highly skilled team of engineers architects and analytics professionals.
Professional growth opportunities including certifications and advanced architecture training.
Collaborative environment that values innovation and continuous improvement.

#LI-MS2

Were a global team of innovators. Together we harness engineering excellence and passion to co-create meaningful solutions to complex challenges. We turn organizations into data-driven leaders that can make a positive impact on their industries and society. If you believe that innovation can bring a better tomorrow closer to today this is the place for you.

Hitachi is a global company operating across a wide range of industries and regions. One of the things that sets Hitachi apart is the diversity of our business and people which drives our innovation and growth.

We are committed to building an inclusive culture based on mutual respect and merit-based systems. We believe that when people feel valued heard and safe to express themselves they do their best work.

We help take care of your today and tomorrow with industry-leading benefits support and services that look after your holistic health and wellbeing. Were also champions of life balance and offer flexible arrangements that work for you (role and location dependent). Were always looking for new ways of working that bring out our best which leads to unexpected ideas. So here youll experience a sense of belonging and discover autonomy freedom and ownership as you work alongside talented people you enjoy sharing knowledge with.

Were proud to say were an equal opportunity employer and welcome all applicants for employment without attention to race colour religion sex sexual orientation gender identity national origin veteran age disability status or any other protected characteristic. Should you need reasonable accommodations during the recruitment process please let us know so that we can do our best to set you up for success.