Lead Data Platform Engineer (Brazil Based)
São Carlos - Brazil
Job Summary
We are looking for a Lead (Senior) Data Sofware Engineer to lead the evolution of a petabyte-scale data platform on this role you will design and build highly scalable resilient and highperformance data pipelines and services applying advanced software and data engineering practices. You will collaborate closely with product engineering and operations teams to enable nextgeneration datadriven marketing solutions accelerate innovation and ensure longterm platform scalability and reliability.
Your key responsibilities
- Design implement and evolve a petabytescale AWS data platform applying advanced engineering distributed systems principles and cloudnative practices to ensure performance reliability and scalability.
- Build and optimize highly scalable data pipelines using JVM languages (Java Scala Kotlin etc...) Spark Python and cloudnative services ensuring efficient resilient and productionready data processing that supports analytics and downstream products.
- Act as a principallevel technical leader mentoring engineers driving highquality code reviews and promoting best practices to elevate engineering maturity across the organization.
- Contribute to architectural and design decisions working closely with architects product owners and engineering leadership to guide platform evolution aligned with business strategy.
- Plan and deliver complex technical initiatives ensuring highquality outcomes predictable execution and effective collaboration within agile valuestream teams.
- Ensure operational readiness by following coding standards testing practices monitoring strategies and release procedures supporting production deployments to maintain platform stability.
- Explore and adopt modern technologies such as GraphQL integrations vector databases and AI/LLMbased techniques enhancing data access platform usability and development efficiency.
Qualifications :
What we expect from you
- Expertlevel software and data engineering experience in largescale data platforms.
- Deep experience building petabytescale systems using Java-based languages such as Scala and Apache Spark.
- Strong expertise across the AWS data ecosystem (Glue S3 Athena Managed Airflow Iceberg).
- Advanced understanding of distributed systems and highly parallelized workloads.
- Strong skills in query optimization data partitioning and efficient storage patterns.
- Cloud ecosystem mastery (AWS required; Azure/GCP are pluses).
- Experience influencing longterm architecture and platform design.
- Excellent code review mentorship and technical leadership capabilities.
- Handson experience working in agile environments and collaborating across multiple engineering teams.
- Strong version control and multirepo collaboration skills (Git GitHub Bitbucket).
- Bachelors degree in Computer Science Engineering or related field or equivalent experience.
- Relevant experience.
- Advanced English and availability to travel to São Carlos/SP when need it.
Nice to have
- Experience with DBT or modern transformation frameworks.
- Knowledge of concurrent and parallel programming.
- Familiarity with Python Angular and TypeScript.
- Experience with vector databases (pgvector Redis vector fields etc.).
- Practical experience applying AI/LLM techniques to data platforms data access or software quality.
Additional Information :
At Serasa Experian we believe that diversity is essential for a healthier and more innovative work environment where everyone can share experiences and express their ideas. Thats why we promote several initiatives to support inclusive recruitment and the professional development of our people.
We also have our affinity groups created to empower and support individuals from underrepresented groups: ExperianPride (LGBTQIAPN community) Ubuntu (racial equity) Women in Experian (gender equity) Aspire (people with disabilities) and Connecting Generations (generations).
Experian Careers - Creating a better tomorrow together
Find out what its like to work for Experian by clicking here
Remote Work :
Yes
Employment Type :
Full-time
About Company
Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, ... View more