Data Engineering

Company Profile
Founded in 1976 CGI is among the largest independent IT and business consulting services firms in the world. With 94000 consultants and professionals across the globe CGI delivers an end-to-end portfolio of capabilities from strategic IT and business consulting to systems integration managed IT and business process services and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at .

Job Title: Senior Developer Data Engineering & Application Support
Position: Senior Software Engineer
Experience: 58 Years
Category: Software Development / Engineering
Shift: 5:30pm - 2:30am
Work Mode: Work from Office / Hybrid (as per business requirement)
Primary Location: Chennai/ Hyderabad India
Employment Type: Full Time

We are looking for an experienced Senior Data Engineer / Developer with strong expertise in data engineering ETL/ELT development SQL cloud data platforms and application/data support. The ideal candidate will be responsible for developing maintaining and supporting enterprise data pipelines and applications across Snowflake Databricks AWS and Oracle/ODI environments.

The role will involve hands-on ETL/ELT development data ingestion SQL development data quality validation production troubleshooting performance optimization testing and deployment activities.

Data Engineering & ETL/ELT Development
Develop maintain and support ETL/ELT pipelines for enterprise data processing.

Develop batch and near real-time data ingestion processes.

Build data transformations and workflows based on technical specifications.

Develop reusable and efficient data-processing components.

Implement error handling logging and recovery mechanisms.

Support data models used for analytics and reporting.

Snowflake / Databricks Development & Support
Develop tables views schemas and data models.

Write and optimize complex SQL queries.

Develop and maintain data-loading and unloading processes.

Develop and support stored procedures and scheduled tasks.

Troubleshoot failed jobs and data-processing issues.

Implement role-based access and permissions as defined by technical design.

Monitor and optimize data-processing jobs for performance.

AWS Development & Support
Develop and support AWS Glue jobs for data ingestion and transformation.

Work with Amazon S3 for file-based data ingestion and storage.

Implement and troubleshoot S3-based ingestion processes.

Work with IAM roles and permissions in accordance with established security guidelines.

Monitor AWS jobs and troubleshoot failures using CloudWatch or equivalent monitoring tools.

Develop file-processing and exception-handling mechanisms.

Oracle / ODI / PL/SQL
Develop and support Oracle Data Integrator (ODI) mappings packages and interfaces.

Develop and troubleshoot PL/SQL procedures functions and scripts.

Support Oracle database-related development and operational activities.

Troubleshoot data integration issues between Oracle and cloud data platforms.

Assist with Oracle database administration activities where required.

Data Quality & Reconciliation
Execute data quality checks and reconciliation between source and target systems.

Investigate data discrepancies and identify the source of data issues.

Perform completeness accuracy and consistency validations.

Fix data-processing defects and implement appropriate preventive controls.

Document data-quality issues and their resolution.

Production Support
Monitor data pipelines and scheduled jobs.

Investigate and resolve production incidents within agreed SLAs.

Perform technical troubleshooting and initial root cause analysis.

Analyze application logs job logs and database errors.

Support recurring incident analysis and implement permanent fixes.

Escalate complex technical issues to the Technical Lead with appropriate analysis and supporting evidence.

Performance Optimization
Identify inefficient SQL queries and data-processing jobs.

Perform SQL tuning and optimization.

Analyze job execution times and resource utilization.

Implement improvements to reduce processing time and operational failures.

Support performance testing and benchmarking activities.

Testing & Deployment
Develop unit and integration test cases for data pipelines.

Validate data transformations and reconciliation results.

Fix defects identified during testing and production.

Prepare deployment scripts and technical implementation documentation.

Support release and deployment activities across Development Test and Production environments.

Participate in post-deployment validation.

Technical Skills
Strong hands-on experience in SQL and ETL/ELT development.

Hands-on experience with Snowflake and/or Databricks.

Experience developing enterprise data pipelines and ingestion processes.

Experience with AWS Glue for data ingestion and transformation.

Experience with Amazon S3 for file-based data ingestion and storage.

Working knowledge of IAM roles permissions and security fundamentals.

Experience with CloudWatch or equivalent cloud monitoring tools.

Strong experience with Oracle and PL/SQL.

Hands-on experience with Oracle Data Integrator (ODI).

Experience with batch and file-based ingestion patterns.

Experience with data validation reconciliation and troubleshooting.

Good understanding of production support and incident management processes.

Experience with SQL query and data-processing job performance optimization.

Experience supporting releases and deployments across multiple environments.

Technical Competencies
SQL: Advanced
ETL/ELT: Advanced
Snowflake / Databricks: IntermediateAdvanced
AWS Glue: Intermediate
Amazon S3: Intermediate
IAM: BasicIntermediate
CloudWatch: BasicIntermediate
Oracle: Advanced
PL/SQL: Advanced
ODI: IntermediateAdvanced
Data Modeling: IntermediateAdvanced
Data Quality & Reconciliation: Advanced
Production Support: Advanced
Performance Tuning: IntermediateAdvanced

Behavioral Skills
Strong troubleshooting and analytical skills.

Good understanding of production-support discipline and incident management.

Ability to work independently and take ownership of assigned issues.

Strong attention to data accuracy and quality.

Ability to work effectively with technical teams and business stakeholders.

Good communication collaboration and documentation skills.

Willingness to participate in production support and incident resolution activities.

Ability to work effectively in a fast-paced enterprise technology environment.

#LI-SS65

• AWS Glue
• Databricks
• Oracle PL/SQL
• Snowflake
• SQL

Together as owners lets turn meaningful insights into action.

Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because

You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.

Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.

Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

That same commitment to fairness extends to how we use technology. To support our recruitment team AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.

Come join our teamone of the largest IT and business consulting services firms in the world.