Data Engineer Capacity Planning Apple Data Platform
Cupertino, CA - USA
Job Summary
As a Data Engineer focused on Capacity Planning you will bring together infrastructure telemetry workload demand capacity commitments and financial data into trusted datasets and data products. You will build the pipelines and analytical foundations used to understand current utilization forecast future needs identify capacity gaps and improve infrastructure efficiency. You will partner with engineering and business teams to turn complex infrastructure data into actionable insights.
Build and maintain data pipelines for infrastructure capacity utilization performance and cost data. nDevelop trusted data models for GPU TPU CPU storage and other infrastructure resources. nBuild cost models that calculate unit economics such as cost per GPU hour cost per job and cost per 1M tokens using measured production utilization. nIntegrate workload demand utilization telemetry capacity commitments and financial data into a common planning framework. nReconcile model outputs to actuals and implement data-quality controls for missing tags anomalies and duplicate records. nBuild forecasting and scenario-analysis tools that help leaders evaluate capacity utilization and pricing decisions before committing spend. nIdentify optimization opportunities such as idle reserved capacity underutilized clusters and inefficient workloads and quantify the associated savings. nAutomate recurring capacity-planning forecasting and reporting workflows. nPartner with engineering teams to understand workload growth migrations SLOs and architecture changes that affect capacity needs. nWork with CIBO Finance and Procurement to support cloud commitments infrastructure investment decisions and long-range capacity planning. nCommunicate insights risks and recommendations clearly to technical and business stakeholders.
3 years of experience in Data Engineering Analytics Engineering Infrastructure Analytics or a related field. nStrong SQL skills and experience working with large datasets. nExperience with Python or another language used for data processing and automation. nExperience building data pipelines data models and analytical datasets. nUnderstanding of ETL/ELT patterns data quality and pipeline working with cloud billing and usage data from AWS GCP or AzurenProven ability to build data models that reconcile to a financial source of truthnUnderstanding of AI and ML inference workloads and how model serving drives compute costnStrong analytical and problem-solving skills. nAbility to work effectively with both technical and non-technical partners. nBachelors degree in Computer Science Engineering Data Science Statistics Mathematics Economics Finance or a related quantitative field or equivalent practical experience.
Experience with infrastructure capacity planning forecasting or resource-management data. nExperience working with GPU TPU CPU storage or cloud infrastructure. nExperience with AWS GCP or similar cloud platforms. nUnderstanding of AI/ML infrastructure and accelerator utilization. nExperience with infrastructure cost billing or utilization datasets. nExperience with technologies such as Spark Trino Airflow Kafka or similar data-platform tools. nExperience with Tableau or other visualization platforms. nFamiliarity with infrastructure economics cloud commitments or capacity optimization. nExperience partnering with Engineering Finance or Procurement on infrastructure planning.
Required Experience:
IC
About Company
Ask Siri to name the most successful company in the world and it might respond: Apple. And it's not just out of familial pride. Apple consistently ranks highly in profit, revenue, market capitalization, and consumer cachet. In 2018, the company became the first reach a trillion dollar ... View more