Software Engineer (Data Analytics), AI & Data Platforms (AiDP)
Sunnyvale, CA - USA
Job Summary
The AiDP Data Services Analytics team builds data analytics and search capabilities provisioning backup/restore observability and self-service spanning OpenSearch ClickHouse SingleStore Couchbase Apache Doris Apache Milvus etc. This role involves supporting data processing and migration efforts across hybrid-cloud environments (On-Prem AWS AliCloud) following established Runbooks and adhering to local data residency and regulatory requirements (e.g. Chinas Cybersecurity Law and PIPL). This role requires good communication and collaboration with infrastructure teams and colleagues across a distributed team.
Build and run data processing platforms with required monitoring alerting and incident management achieving growing independencennBuild working knowledge of data analytics and search concepts (distributed data processing fast querying consistency models) across OpenSearch ClickHouse Couchbase Doris Milvus performance engineering efforts (profiling tuning) under guidance from senior team membersnnAssist with service management across bare metal virtualized (EC2 AliCloud ECS) and containerized (K8s) style platformsnnExecute and support data migration tasks across hybrid clouds including validation and rollback supportnnBuild understanding of operating systems and datacenter architecture concepts relevant to transactional workloadsnnProduce and maintain clear documentation Runbooks architecture diagrams and migration playbook updatesnnSupport compliance with local data residency and regulatory requirements applicable to China-based infrastructure
3 years experience in data analytics and/or data search spacennExperience and knowledge of Java or Python programming languagesnnHands-on production experience with at least one of the following technologies: Solar Elastic Search Iceberg ClickHouse Doris and/or CouchbasennExposure to running infrastructure with reliance on automation tooling across Datacenter and Cloud architectures (including Alibaba Cloud and/or AWS)nnBachelors or Masters degree in Computer Science or a related work experience
Some operational experience with stateful services on KubernetesnnExposure to database-as-a-service control planes provisioning APIs or self-service toolingnnExperience assisting with cross-cloud / hybrid-cloud data migrations for transactional systemsnnFamiliarity with observability concepts (SLIs/SLOs) backup and DR practices for OLTP/distributed-SQL enginesnnSolid troubleshooting skills a resourceful first-principles approach to problem solving and good technical writing habitsnnContributions to open-source database projects or internal data-platform tooling
Required Experience:
IC
About Company
Ask Siri to name the most successful company in the world and it might respond: Apple. And it's not just out of familial pride. Apple consistently ranks highly in profit, revenue, market capitalization, and consumer cachet. In 2018, the company became the first reach a trillion dollar ... View more