QA Engineer(Databricks)
Job Summary
Overview of 66degrees
66degrees is an end-to-end AI transformation partner that guides enterprises from complex business challenges to clear quantifiable outcomes. Our company is the culmination of several successful firms each a leader in its own right in cloud artificial intelligence and data. This convergence of talent and expertise is how we help businesses reach their own inflection point where chaotic data becomes a strategic asset complexity becomes clarity and AI becomes an engine for growth. Our ultimate vision is to be the catalyst for a future where every business operates as an intelligent enterprise with autonomous systems unlocking human potential.
At 66degrees we believe in thriving through challenges and winning together. These values not only guide us in achieving our goals as a company but also for our people. We are dedicated to creating a significant impact for our employees by fostering a culture that sparks innovation and supports professional and personal growth along the way.
Overview of 66degrees
66degrees is an end-to-end AI transformation partner that guides enterprises from complex business challenges to clear quantifiable outcomes. Our company is the culmination of several successful firms each a leader in its own right in cloud artificial intelligence and data. This convergence of talent and expertise is how we help businesses reach their own inflection point where chaotic data becomes a strategic asset complexity becomes clarity and AI becomes an engine for growth. Our ultimate vision is to be the catalyst for a future where every business operates as an intelligent enterprise with autonomous systems unlocking human potential.
At 66degrees we believe in thriving through challenges and winning together. These values not only guide us in achieving our goals as a company but also for our people. We are dedicated to creating a significant impact for our employees by fostering a culture that sparks innovation and supports professional and personal growth along the way.
Overview of Role
We are looking for a Databricks Tester with 35 years of experience in data testing andvalidation. The ideal candidate should have hands-on experience validating data pipelines andDatabricks Delta tables ensuring data accuracy completeness and consistency. The rolerequires strong SQL skills experience with Databricks and proficiency in defect managementusing JIRA.
Responsibilities:
- Validate data in Databricks Delta tables across Bronze Silver and Gold layers.
- Perform source-to-target data validation and reconciliation.
- Verify data transformations business rules and aggregation logic.
- Execute SQL queries to validate data accuracy completeness consistency and integrity.
- Validate schemas data types null values duplicate records and primary key constraints.
- Perform regression integration and end-to-end testing for data pipelines.
- Create execute and maintain test cases and test scenarios based on business
- requirements.
- Log track and manage defects using JIRA and work closely with Data Engineers to
- resolve issues.
- Participate in Agile ceremonies including sprint planning daily stand-ups and
- retrospectives.
- Prepare test execution reports and communicate testing status to stakeholders.
Qualifications:
- 35 years of experience in Data Testing ETL Testing or Data Validation.
- Hands-on experience with Databricks and Delta Lake.
- Strong proficiency in SQL for data validation and reconciliation.
- Experience validating ETL/ELT pipelines and data transformations.
- Knowledge of Spark SQL and Databricks notebooks.
- Experience with JIRA for defect tracking and test management.
- Understanding of data warehousing concepts and relational databases.
- Experience working in Agile/Scrum environments.
- Strong analytical troubleshooting and communication skills.
- Basic knowledge of PySpark and Python
- Experience with Azure Databricks.
- Experience with ETL testing.
- Exposure to Azure DevOps or Git for version control.
- Familiarity with data quality frameworks and test automation tools.
66degrees is an Equal Opportunity employer. All qualified applicants will receive consideration for employment without regard to actual or perceived race color religion sex gender gender identity national origin age weight height marital status sexual orientation veteran status disability status or other legally protected class.
66degrees is an Equal Opportunity employer. All qualified applicants will receive consideration for employment without regard to actual or perceived race color religion sex gender gender identity national origin age weight height marital status sexual orientation veteran status disability status or other legally protected class.
AI Transparency & Disclosure
As an AI transformation partner 66degrees leverages intelligent solutions to enhance our recruitment experience. We utilize AI toolsincluding LinkedIn Recruiters Hiring Assistant and interview transcription technologiesto assist with sourcing role analysis and capturing interview highlights.
These tools augment our process but we Commit to Our Craft by ensuring all final hiring decisions are made by our human Talent Team. By applying you acknowledge the use of these technologies to help us Win Together in finding the best fit for our team.
Required Experience:
IC
About Company
66degrees is a leading consulting and professional services company specialized in delivering Data and AI services and solutions to enterprise companies.