Databricks Subject Matter Expert

VLink founded in 2006 is a leading global provider of software engineering services with next-gen technologies and best-in-class talent. Our Headquarters are in the U.S and we have offices in 7 countries from North America-Europe to APAC with expansion plans in the Middle East. With over 1000 employees working globally VLink has helped SMBs and large enterprises achieve their business goals and gained the trust of Fortune-250 companies. VLink is Great Place to Work CertifiedTM and has been a consistent winner as- Best Places to Work in CT. Trust collaboration and accountability are the three elements that are at the core of VLinks work culture. We value our professionals providing comprehensive benefits and the opportunity for growth.

We are seeking a highly experienced Databricks Subject Matter Expert to join at the Lead / Principal this role you will serve as the firms foremost technical authority on the Databricks Lakehouse Platform guiding clients through complex data transformation initiativesfrom strategic architecture design through hands on implementation and production deployment.
You will partner directly with client stakeholders (CTOs VPs of Data and Engineering Leads) to define data strategies architect scalable solutions on Databricks and mentor delivery teams. This is a high visibility role that blends deep technical expertise with client advisory pre sales support and thought leadership.

• Lead end to end design of Databricks Lakehouse architectures including Delta Lake Unity Catalog and medallion (bronze/silver/gold) data models.

• Define reference architectures best practices and reusable accelerators for client engagements.

• Evaluate and recommend deployment patterns across Azure Databricks AWS Databricks and GCP aligning platform choices with client infrastructure and governance needs.

Data Engineering & Pipeline Development

• Architect and oversee large scale ETL/ELT pipelines using Apache Spark Delta Live Tables and Databricks Workflows.

• Design real time and batch ingestion frameworks covering structured semi structured and unstructured data sources.

• Establish data quality lineage and observability standards using Unity Catalog Delta Lake features and complementary tooling.

Machine Learning & MLOps

• Guide clients on implementing end to end ML workflows using MLflow Feature Store and Model Serving on Databricks.

• Advise on MLOps patterns including model versioning A/B testing monitoring and automated retraining pipelines.

• Collaborate with data science teams to productionize models and integrate ML outputs into business applications.

• Serve as the trusted advisor to senior client stakeholders on all matters related to data platform strategy and Databricks adoption.

• Lead discovery workshops architecture reviews and technical assessments to define solution roadmaps.

• Support pre sales efforts by developing proposals estimating level of effort and delivering technical demonstrations.

• Contribute to the firms intellectual property by developing frameworks white papers and training curricula around Databricks.

• Mentor and upskill consultants across the data practice; foster a community of Databricks practitioners.

• Represent the firm at industry events Databricks partner summits and webinars.

• 10 years of professional experience in data engineering analytics or platform architecture.

• 5 years of deep hands on experience with Databricks including production deployments at enterprise scale.

• Expert level proficiency in Apache Spark (PySpark and/or Scala) Delta Lake and SQL.

• Proven track record designing multi cloud Lakehouse architectures (Azure AWS or GCP).

• Strong experience with Unity Catalog for data governance access control and lineage tracking.

• Demonstrated ability to lead client facing engagements and communicate complex technical concepts to executive audiences.

• Experience in a consulting or professional services environment with a history of managing multiple concurrent engagements.

• Bachelors degree in Computer Science Engineering Data Science or a related field (or equivalent practical experience).

• Databricks Certified Data Engineer Professional or Machine Learning Professional certification.

• Experience with Delta Live Tables Databricks Workflows and Photon engine optimization.

• Familiarity with complementary tools such as dbt Terraform/Pulumi (IaC) and CI/CD pipelines for data platforms.

• Hands on experience with MLflow Feature Store and Model Serving in production environments.

• Prior experience as a Databricks partner or in a Databricks aligned practice within a consulting firm.

• Advanced degree (M.S. or Ph.D.) in a quantitative or technical discipline.

VLink is an equal opportunity employer committed to fostering an inclusive environment where diversity is celebrated. All qualified applicants will be considered for employment without regard to race color religion sex sexual orientation gender identity national origin disability or veteran status. Employment is contingent upon successful completion of a background check.

This job application process may use AI-powered tools to assist in screening and evaluating applications based on objective job-related qualifications. AI is used solely to support the recruitment process and all final hiring decisions are made exclusively by our human recruitment team.

Applicant information will be handled in accordance with VLinks privacy policy.