Databricks Developer – Python & Scala

Position Title: Databricks Developer  Python & Scala Location: Dallas TX  onsite Duration: 12 Months with possible extension Experience: 7 years Job Description We are looking for an experienced Databricks Developer with strong expertise in Python Scala Apache Spark and cloud-based data engineering. The ideal candidate will be responsible for designing developing and optimizing scalable data pipelines and data processing solutions using the Databricks platform. Required Skills:

• 7 years of experience in Data Engineering / Big Data development.

•  Strong hands-on experience with Databricks.

•  Strong programming experience in Python and Scala.

•  Excellent knowledge of Apache Spark / PySpark.

•  Strong experience with SQL and relational databases.

•  Hands-on experience with Delta Lake / Delta tables.

•  Experience developing and managing Databricks notebooks and workflows/jobs.

•  Strong understanding of ETL/ELT concepts and data pipeline architecture.

•  Experience with cloud platforms such as Azure or AWS.

•  Experience with Git and CI/CD.

•  Strong problem-solving and communication skills.

Preferred Skills:

•  Experience with Azure Data Factory (ADF).

•  Experience with Azure Data Lake Storage (ADLS).

•  Experience with AWS S3 Glue EMR or similar services.

•  Knowledge of Kafka or other streaming technologies.

•  Experience with Databricks Unity Catalog and data governance.

•  Knowledge of Terraform and Infrastructure as Code.

•  Experience with Jenkins/Azure DevOps.

•  Experience working in large enterprise environments preferably telecommunications.

Required Skills:

Data EngineeringPython and ScalapySpark