Lead Data Engineer
Job Summary
This is a remote position.
Data Engineering Lead@ PEOPLE10
Experience: 7 - 9 years
Job Location: Bangalore (Remote)
Shift : 2pm to 11pm IST
Job Overview:
Are you someone who enjoys designing modern data platforms experimenting with cloud-native architectures and turning raw data into scalable enterprise-ready solutions Do you thrive in fast-paced environments where innovation rapid prototyping and solutioning go hand in hand If so People10 is the place for you.
P10 is seeking an experienced Lead Data Engineer with strong Cloud expertise to join our team a high-impact innovation-focused team responsible for building data-driven PoCs reference architectures and scalable cloud-native data platforms. This role sits at the intersection of data engineering cloud architecture and solution strategy enabling P10 to deliver modern enterprise-grade data solutions.
In this role you will design and implement end-to-end data pipelines orchestrate real-time and batch data flows and build cloud-native solutions across Azure/AWS/GCP.
This position is ideal for a hands-on architecture-minded lead who thrives in a fast paced environment can lead a team independently and confidently present solutions to customers and internal stakeholders.
Roles & Responsibilities
Solution Design & Architecture
Design end-to-end data architectures including ingestion transformation storage and consumption layers.
Evaluate and propose scalable cloud-native platform solutions.
Create data models data flow diagrams and architecture blueprints.
Cloud Data Engineering
Build and optimize ETL/ELT pipelines using cloud-native services (Azure Data Factory AWS Glue GCP Dataflow).
Implement real-time streaming pipelines using Kafka Event Hubs Kinesis or Pub/Sub.
Develop scalable data lakes lakehouses and warehouses (Delta Lake BigQuery Redshift Snowflake).
Work with cloud functions serverless compute and event-driven architectures.
Data Processing & Modeling
Transform and process large datasets using Spark Databricks PySpark or SQL engines.
Implement batch and streaming workflows for analytics or AI/ML consumption.
Ensure data quality lineage auditing and governance best practices.
Collaboration & Solutioning
Participate in requirement gathering meetings and customer workshops as a data engineering expert.
Work closely with the client team to understand the enterprise landscape to come up with DataModel
Support team members by reviewing designs and unblocking technical issues.
Operationalization
Build CI/CD pipelines for data components and automate deployment workflows.
Implement cost optimization scalability and performance tuning for cloud data workloads.
Ensure security best practices across identity data encryption access control and network design.
What Were Looking For
Technical Skills
Strong programming skills in Python or Scala SQL and data transformation logic.
Hands-on experience with cloud-native data services including:
Azure: Data Factory Synapse Databricks Event Hub
AWS: Glue EMR Redshift Kinesis Lambda
GCP: Dataflow DataProc BigQuery Pub/Sub
Experience with Spark / PySpark distributed data processing and pipeline performance tuning.
Proficiency with data modeling schema design star/snowflake models.
Strong knowledge of data lake / lakehouse architectures (Delta Lake Iceberg Hudi).
Experience with streaming frameworks (Kafka Event Hub Kinesis).
Familiarity with containerization (Docker) and CI/CD (GitHub Actions Azure DevOps etc.).
Knowledge of security: IAM VNet encryption governance.
Professional Skills
Ability to translate business needs into scalable data solutions.
Strong documentation diagramming and solution presentation skills.
Comfortable in technical demonstrations.
Good-to-Have Skills
Experience with Snowflake Databricks advanced features (Unity Catalog).
Familiarity with event-driven microservices and API development.
Understanding of data observability tools (Great Expectations Monte Carlo).
Experience working in multi-cloud hybrid environments.
Why Join People10
At People10 you will be immersed in an exceptional work environment surrounded by helpful colleagues and a workplace where feedback flows freely. If youre looking to make an impact People10 is the place for you. People10 is an equal opportunity employer. We welcome and encourage diversity in the workplace regardless of race gender religion age sexual orientation gender identity disability or veteran status. Our culture of open door policy constant connection with leadership team opportunities for skill development through diversified learning initiatives like code combat meetups knowledge booster sessions makes People10 an rewarding place to People10 we dont just build software but we also build careers. You will be: Be part of a growing design-led digital transformation firm solving real tech problems.
Collaborate with smart driven teammates across geographies.
Enjoy autonomy creative freedom and the opportunity to make a visible impact.
Learn upskill and lead we believe in growing people alongside platforms.
We would love to meet you if you are ready to take initiative and make your mark in a high-impact marketing role.