Databricks Admin with Python, Pyspark

Position Title: Databricks Admin with Python Pyspark
Work location: Dallas TX/LA - onsite
Duration: 12 plus months contract with possible extension

We are looking for Databricks administrator with 8 years of relevant experience.

Job duties:

Responsibilities will include designing implementing and maintaining the Databricks platform and providing operational support

Operational support responsibilities include platform set-up and configuration workspace administration resource monitoring providing technical support to data engineering Data Science/ML and Application/integration teams performing restores/recoveries troubleshooting service issues determining the root causes of issues and resolving issues

Assist in the deployment and configuration of Databricks environments ensuring alignment with best practices for security and performance

Responsible for the administration configuration and optimization of the Databricks platform to enable data analytics machine learning and data engineering activities within the organization

Install configure and maintain Databricks clusters and workspaces

Maintain Platform currency with security compliance and patching best practices

Monitor and manage cluster performance resource utilization platform costs and troubleshoot issues to ensure optimal performance

Implement and manage access controls and security policies to protect sensitive data

Manage schema data with Unity Catalog - create configure catalog external storage and access permissions

Manage AWS resources related to Databricks and networking configurations

Technical Competencies:

Strong understanding of data engineering needs

Strong understanding of aws infrastructure required by Databricks

Experience with compliance audits/audit documentation

Experience using Databricks APIs system tables for creating admin related queries and dashboards

Understanding of the Databricks workspace and development environment

Strong debugging skills

Proficiency in pySpark Python SQL and aws

Skills :

4 years - database admin

2 years - databricks admin

2 years - python pyspark

Required Skills:

data engineering Data Science/MLdata analytics machine learning