Big Data Developer – Snowflake, Spark & AWS
Job Location:
Monthly Salary:
Posted on:
Yesterday
Posted on:
Vacancies:
1 Vacancy
Vacancies:
Job Summary
Big Data Developer Snowflake Spark & AWS
Location: Toronto
Hybrid 4 days WFO
Position Overview
We are seeking an experienced Senior Big Data Developer to join Royal Bank of Canadas Data Engineering team. You will design build and optimize scalable data pipelines and infrastructure to support our enterprise data analytics and business intelligence initiatives.
Key Responsibilities
Design and develop robust ETL/ELT pipelines using Spark Hive and Hadoop for large-scale data processing
Architect and maintain Snowflake data warehouse solutions including schema design and optimization
Develop and manage infrastructure-as-code solutions using AWS services (S3 Glue EMR RDS)
Build and deploy containerized applications using Docker/Kubernetes and OpenShift (OCP4)
Implement CI/CD pipelines and version control best practices using Git
Collaborate with data scientists and analytics teams to ensure data quality and accessibility
Mentor junior team members and contribute to technical documentation
Leverage Gen AI tools to enhance code quality and development efficiency
Required Qualifications
5 years of hands-on experience with big data technologies (Hadoop Spark Hive)
Advanced proficiency with Snowflake platform and data modeling
Strong SQL expertise and database design knowledge
Proven experience with AWS cloud services
Programming experience in Scala Python or Java
Knowledge of SCM infrastructure-as-code and CI/CD pipeline implementation
Excellent problem-solving communication and self-directed work ethic
Preferred Qualifications
Experience with orchestration tools (Apache Airflow)
ETL tool expertise (Informatica Talend)
API development experience
Containerization and Kubernetes expertise
Scripting proficiency (Shell Python)
Understanding of Gen AI for code generation
