Specialist Data Engineering

Job Summary

Seeking a Specialist with 5 to 7 years of experience in Scala and Apache Spark to design and implement scalable big data solutions within the Hadoop ecosystem

Job Description

Extensive handson experience with Apache Spark for largescale data processing and analytics
Proficient in big data technologies within the Hadoop ecosystem Strong programming skills in Scala for data engineering tasks
Deep understanding of distributed computing frameworks and performance optimization techniques
Experience with batch and realtime data processing pipelines Knowledge of data ingestion transformation and storage best practices
Familiarity with data quality assurance validation and troubleshooting in big data environments
Ability to work with complex data architectures and cloudbased big data platforms
Skilled in debugging and optimizing Spark jobs to ensure efficient resource utilization
Understanding of data security compliance and governance within big data solutions

Roles and Responsibilities

Design develop and maintain scalable and robust data pipelines using Apache Spark SparkSQL Scala and related big data technologies
Collaborate with cross functional teams to gather business requirements and translate them into technical solutions
Optimize Spark applications for performance scalability and cost efficiency
Lead the implementation of data processing workflows ensuring data quality and consistency
Provide technical mentorship and guidance to junior team members and peers
Participate in architectural reviews and recommend best practices for big data solution design
Troubleshoot and resolve complex issues in data processing pipelines within defined SLAs
Stay updated with emerging big data technologies and incorporate relevant advancements into existing systems
Ensure adherence to organizational standards for data security compliance and governance

Mandatory Skills : Java Microservices Java SpringBoot

Vacancy Type: New Vacancy

Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree Canada (LTIMC):

Benefits and Perks:

• Comprehensive Medical Plan Covering Medical Dental Vision
• Health Care Spending Account
• Short Term and Long-Term Disability Coverage
• Life Insurance
• Annual vacation and other Paid Leaves
• Maternity Leave Top Up Pay

The range displayed on each job posting reflects the total compensation range for the position across all Canada locations. Within the range individual pay is determined by work location and job level and additional factors including job-related skills experience and relevant education or training. Depending on the position offered other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus sales incentive pay and other forms of bonus or variable compensation.

Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting.

LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race color creed religion sex (including pregnancy childbirth or related medical conditions) gender identity or expression national origin ancestry age family-care status veteran status marital status civil union status domestic partnership status military service handicap or disability or history of handicap or disability genetic information atypical hereditary cellular or blood trait union affiliation affectional or sexual orientation or preference or any other characteristic protected by applicable federal state or local law except where such considerations are bona fide occupational qualifications permitted by law.

Accessibility and Reasonable Accommodation:LTIMindtree has an accommodation process in place and provides accommodations for applicants with disabilities. If you require a specific accommodation because of a disability or a medical need please write to us at so that arrangements can be made for the appropriate accommodations to be in place.