DevOps Data Hadoop Engineer – Kubernetes, CICD & Big Data

Job Summary

Synechron is seeking a DevOps Data Hadoop Technology Engineer with 7 years of experience in DevOps platform engineering infrastructure management and big data role will design and manage CI/CD pipelines containerized platforms infrastructure as code and distributed data solutions using Jenkins GitOps Kubernetes OpenShift Terraform Ansible Hadoop Spark and Kafka. The position will contribute to business objectives by improving deployment efficiency platform reliability data-processing performance scalability security and operational resilience.

Software Requirements

Required

• Minimum 7 years of experience in DevOps platform engineering infrastructure engineering data engineering or related technology roles.

• Experience designing implementing and managing CI/CD pipelines using Jenkins and related automation tools.

• Knowledge of GitOps principles and version-controlled application and infrastructure delivery.

• Experience deploying and managing containerized applications using Kubernetes and OpenShift.

• Experience developing and maintaining Infrastructure as Code using Terraform Ansible or equivalent tools.

• Hands-on experience with big data technologies such as Hadoop Spark and Kafka.

• Understanding of distributed data architectures data processing storage scalability fault tolerance and high availability.

• Experience implementing monitoring logging alerting and observability solutions.

• Knowledge of infrastructure application and data-platform security practices.

• Familiarity with governance standards compliance requirements change management and operational support.

• Experience collaborating with development operations data engineering infrastructure and security teams.

• Ability to use current and supported versions of relevant tools and technologies based on project requirements.

Preferred

• Experience managing cloud-based Kubernetes OpenShift and big data platforms.

• Familiarity with automated testing code quality checks security scanning and compliance controls in CI/CD pipelines.

• Experience with data lake event-driven batch and streaming architectures.

• Knowledge of container security image management service mesh and platform governance.

• Familiarity with deployment automation configuration management and infrastructure monitoring tools.

• Experience with capacity planning disaster recovery incident response and platform resilience.

• Knowledge of cost optimization resource efficiency and sustainable infrastructure practices.

Overall Responsibilities

• Design implement and manage CI/CD pipelines using Jenkins GitOps practices and related automation tools.

• Automate the software development lifecycle from source-code integration through deployment and operational support.

• Deploy configure and manage containerized applications using Kubernetes and OpenShift.

• Develop maintain and automate infrastructure using Terraform Ansible or equivalent Infrastructure as Code tools.

• Architect implement and support big data platforms and solutions using Hadoop Spark Kafka and related technologies.

• Design and manage distributed data architectures that support efficient scalable and fault-tolerant data processing and storage.

• Collaborate with development operations data engineering infrastructure and security teams to understand requirements and deliver robust technical solutions.

• Implement monitoring logging alerting and observability for applications infrastructure containers and data platforms.

• Optimize system performance reliability scalability availability and resource utilization.

• Troubleshoot deployment failures infrastructure issues container problems data-processing errors and platform incidents.

• Apply security best practices to infrastructure applications CI/CD pipelines containers and data platforms.

• Support governance compliance audit change management and operational readiness activities.

• Maintain technical documentation for pipelines infrastructure deployment procedures platform configurations and operational processes.

• Identify opportunities to improve automation delivery efficiency platform resilience data processing and sustainability.

• Ensure solutions meet agreed technical security operational performance and business requirements.

Technical Skills (By Category)

Programming Languages

Essential

• Ability to use scripting and programming languages for automation deployment configuration and operational support.

• Understanding of command-line tools build processes configuration management and automation concepts.

• Ability to read and modify pipeline scripts deployment manifests infrastructure definitions and configuration files.

• Understanding of programming and implementation concepts relevant to distributed systems and data platforms.

Preferred

• Experience with Python Bash or another scripting language.

• Familiarity with Java Scala or another language used in big data environments.

• Experience developing reusable automation scripts deployment utilities and operational tools.

Databases/Data Management

Essential

• Understanding of Hadoop-based storage and distributed data processing.

• Experience supporting large-scale data storage processing movement and retention.

• Knowledge of data availability integrity partitioning replication backup and recovery.

• Understanding of batch and streaming data-processing requirements.

• Ability to support data platforms across development testing and production environments.

Preferred

• Experience with data lakes data warehouses and distributed file systems.

• Familiarity with structured semi-structured and unstructured data.

• Knowledge of data governance metadata lineage retention and data quality practices.

• Experience with data replication disaster recovery and platform capacity planning.

• Understanding of data security and privacy controls.

Cloud Technologies

Essential

• Understanding of cloud computing concepts infrastructure networking storage compute and identity management.

• Knowledge of cloud-based container and data-platform deployment.

• Understanding of availability scalability monitoring security and cost considerations in cloud environments.

• Ability to support infrastructure and data solutions across cloud and on-premises environments.

Preferred

• Experience operating Kubernetes OpenShift Hadoop Spark or Kafka in cloud environments.

• Familiarity with cloud-managed container storage networking monitoring and data services.

• Experience with cloud infrastructure automation and platform provisioning.

• Knowledge of cloud cost optimization and sustainable resource utilization.

Frameworks and Libraries

Essential

• Hadoop for distributed storage and data-processing environments.

• Apache Spark for large-scale data processing.

• Apache Kafka for event streaming and distributed messaging.

• Kubernetes for container orchestration.

• OpenShift for enterprise container platform management.

• Familiarity with deployment manifests configuration files service definitions and infrastructure modules.

Preferred

• Experience with Spark batch and streaming workloads.

• Knowledge of Kafka topics partitions consumer groups retention and delivery patterns.

• Familiarity with Kubernetes operators Helm charts ingress services configuration management and persistent volumes.

• Experience developing reusable Terraform modules and Ansible roles.

• Knowledge of service mesh container registries and platform automation frameworks.

Development Tools and Methodologies

Essential

• Jenkins and CI/CD pipeline development.

• Git-based source control and GitOps delivery practices.

• Terraform or Ansible for Infrastructure as Code and configuration management.

• Experience with build automation deployment automation environment promotion and release controls.

• Knowledge of Agile or iterative software delivery practices.

• Familiarity with issue tracking documentation change management incident management and operational support.

• Experience with monitoring logging alerting and performance analysis tools.

Preferred

• Experience implementing automated testing code quality checks vulnerability scanning and compliance controls in pipelines.

• Familiarity with declarative deployment pull-based delivery and configuration drift management.

• Knowledge of observability practices dashboards tracing incident response and service-level monitoring.

• Experience with disaster recovery testing capacity planning and platform resilience assessments.

• Familiarity with automated infrastructure validation and policy enforcement.

Security Protocols

Essential

• Understanding of secure infrastructure and secure software delivery principles.

• Knowledge of authentication authorization identity and access management encryption secrets management and secure connectivity.

• Ability to apply security controls to CI/CD pipelines container platforms infrastructure and data environments.

• Awareness of vulnerability management audit logging image security and secure configuration practices.

• Understanding of data protection confidentiality integrity availability and regulatory requirements.

Preferred

• Experience with container image scanning runtime security network policies and platform hardening.

• Familiarity with role-based access control secrets vaults certificate management and policy enforcement.

• Knowledge of security testing and compliance validation within CI/CD pipelines.

• Experience supporting security reviews risk assessments remediation activities and audit requirements.

Experience Requirements

• Minimum 7 years of experience in DevOps platform engineering infrastructure engineering data engineering or related technology roles.

• Experience designing and managing CI/CD pipelines using Jenkins and Git-based delivery practices.

• Experience applying GitOps principles to application and infrastructure deployment.

• Experience deploying and managing containerized applications using Kubernetes and OpenShift.

• Experience developing Infrastructure as Code using Terraform Ansible or equivalent technologies.

• Hands-on experience with Hadoop Spark and Kafka.

• Experience designing or supporting distributed data architectures.

• Experience implementing monitoring logging alerting observability performance optimization and operational support.

• Experience troubleshooting platform deployment infrastructure container and data-processing issues.

• Experience collaborating with development operations data infrastructure and security teams.

• Experience working in enterprise regulated financial services or data-intensive environments is preferred.

• Candidates may also qualify through equivalent practical experience relevant certifications professional training or demonstrated delivery of complex DevOps and big data platforms.

Day-to-Day Activities

• Design maintain and improve Jenkins and GitOps-based CI/CD pipelines infrastructure automation deployment configurations and environment promotion processes.

• Deploy and support containerized applications and big data workloads across Kubernetes OpenShift and related infrastructure environments.

• Collaborate with development operations data engineering infrastructure and security teams through planning sessions technical reviews incident discussions and delivery activities.

• Monitor platform performance investigate incidents optimize resources maintain documentation and make implementation decisions within established security and operational standards.

Qualifications

• Bachelors degree in Computer Science Information Technology Engineering or a related field; equivalent professional experience may be considered.

• Minimum 7 years of experience in DevOps infrastructure engineering data engineering platform engineering or related technology roles.

• Certifications in Kubernetes cloud computing DevOps Infrastructure as Code big data or security are preferred.

• Complete Synechron-required training related to information security data protection workplace conduct risk management and responsible technology use.

• Maintain continuous professional development in CI/CD GitOps Kubernetes OpenShift Terraform Ansible Hadoop Spark Kafka cloud technologies monitoring and security.

Professional Competencies

• Critical thinking systems analysis technical investigation and structured problem-solving.

• Cross-functional collaboration technical ownership knowledge sharing and delivery accountability.

• Clear communication with technical and non-technical stakeholders.

• Adaptability continuous learning and effective response to evolving platforms and operational requirements.

• Innovation focused on automation reliability scalability security and sustainable infrastructure practices.

• Effective prioritization organization time management incident response and delivery focus.

SYNECHRONS DIVERSITY & INCLUSION STATEMENT

Diversity & Inclusion are fundamental to our culture and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity Equity and Inclusion (DEI) initiative Same Difference is committed to fostering an inclusive culture promoting equality diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger successful businesses as a global company. We encourage applicants from across diverse backgrounds race ethnicities religion age marital status gender sexual orientations or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements mentoring internal mobility learning and development programs and more.

All employment decisions at Synechron are based on business needs job requirements and individual qualifications without regard to the applicants gender gender identity sexual orientation race ethnicity disabled or veteran status or any other characteristic protected by law.

Candidate Application Notice