Big Data + Snowflake Engineer
Job Summary
Job Description:
-
Translate complex business and analytical needs into scalable resilient data architectures and pipelines.
-
Design and implement high performance distributed pipelines (batch & streaming) with strong SLAs monitoring and cost efficiency.
-
Build lakehouse and warehouse solutions (e.g. Delta/Iceberg/Hudi Snowflake) with robust semantic/data models.
-
End to end ownership: requirements architecture build deploy monitor optimize.
-
ETL/ELT excellence with Informatica SnapLogic Azure Data Factory Azure Functions Python and Databricks/Spark.
-
Azure platform proficiency including: Azure Data Factory Azure Databricks AKS Azure Service Bus (ASB) API Management Storage Accounts Event Hub/Event Grid Redis Cache.
-
Strong RDBMS/NoSQL experience: Oracle SQL Server/SQL MI MySQL Postgres Cosmos DB MongoDB.
-
DataOps/DevOps: CI/CD pipelines (GitHub Actions/Azure DevOps) unit/integration tests automated data quality and infrastructure as code (Bicep/ARM/Terraform).
-
Data quality & observability (e.g. Great Expectations/Deequ/Monte Carlo) schema evolution partitioning and performance tuning.
-
Build tools and frameworks that turn pipelines into actionable insights for key business KPIs; partner with BI/analytics teams.
-
Strong Agile delivery-driving epics stories and tasks using Agile/Scrum and Jira; excellent written and verbal communication