Production Support Engineer (Hadoop)

Position Description:

Role Summary
We are seeking a skilled Production Support Engineer (Hadoop) with strong expertise in Big Data ecosystem support job monitoring and troubleshooting. The ideal candidate will have hands on experience with Hadoop services Linux administration and Spark based application debugging along with exposure to scheduling tools and incident management systems.

Experience: 35 Years

#LI-SY4

Location: Hyderabad

Work: 24/7 Rotational shift 5 days work from office in ODC environment L1/L2 support No hybrid access.

Key Responsibilities

. Monitor and manage batch jobs using CA7 scheduler including tracking job failures and analyzing CA7 logs
. Perform incident management and ticket handling using ServiceNow ensuring timely resolution and SLA adherence
. Troubleshoot and support Hadoop ecosystem components such as YARN Hive and Impala
. Debug and resolve issues in PySpark jobs including performance tuning and error analysis
. Work with HDFS and HQL (HDFS SQL / Hive queries) for data validation and issue resolution
. Develop and maintain shell scripts for automation and operational tasks
. Analyze system logs and identify root causes of failures across the Big Data platform
. Collaborate with development infrastructure and support teams for issue resolution and system improvements


Required Skills & Qualifications

. Strong experience in Linux (RHEL) administration and command line operations
. Hands on experience with Hadoop ecosystem components:
. Proficiency in PySpark with solid debugging and troubleshooting skills
. Experience with CA7 job scheduling and monitoring
. Knowledge of Shell scripting for automation
. Familiarity with ServiceNow or similar ticketing tools
. Good understanding of data processing workflows and ETL pipelines

Skills:

• Communication
• Infrastructure
• Hadoop Ecosystem (HDFS)
• Hadoop Hive
• Linux

What you can expect from us:

Together as owners lets turn meaningful insights into action.

Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because

You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.

Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.

Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

That same commitment to fairness extends to how we use technology. To support our recruitment team AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.

Come join our teamone of the largest IT and business consulting services firms in the world.