Kafka Developer

Role Overview: We are seeking a highly skilled Kafka Engineer to design build and optimize real-time data streaming solutions within the financial services domain. The ideal candidate will have strong expertise in Apache Kafka distributed systems and event-driven architectures with a focus on secure scalable and high-performance data pipelines supporting mission-critical financial applications.

Key Responsibilities:

• Design develop and maintain Kafka-based streaming platforms for financial transaction processing fraud detection and risk management.
• Implement data ingestion pipelines from multiple sources (trading systems payment gateways customer data platforms).
• Ensure high availability scalability and fault tolerance of Kafka clusters in production environments.
• Collaborate with business analysts data engineers and application developers to integrate Kafka with financial applications and legacy systems.
• Monitor troubleshoot and optimize Kafka performance ensuring compliance with financial industry standards and regulations.
• Develop automation scripts for deployment monitoring and alerting using tools like Kubernetes Docker and CI/CD pipelines.
• Implement security best practices including encryption authentication and role-based access control for sensitive financial data.
• Provide technical leadership and mentoring to junior engineers on Kafka and event-driven architecture.

Required Skills & Experience:

• 5 years of experience in Kafka engineering with at least 2 years in the financial domain.
• Strong knowledge of Apache Kafka Kafka Streams Kafka Connect and Schema Registry.
• Experience with distributed systems microservices and event-driven architectures.
• Proficiency in Java Scala or Python for building Kafka producers/consumers.
• Hands-on experience with cloud platforms (Azure AWS or GCP) and containerization (Docker Kubernetes).
• Familiarity with financial systems such as payment processing trading platforms or risk management solutions.
• Strong understanding of data security compliance and regulatory requirements in financial services.

Pi-square technologies is a Michigan (USA) Headquartered Automotive Embedded Engineering Services company Synergy Partner for major OEMs and Tier 1s and their implementation partners in Automotive Embedded Product Development Projects Requirements Analysis Software Design Software Implementation Efficient Build Release Process and turnkey software V & V Services. We have more than 20 years of industry expertise with specialization in the latest cutting-edge automotive technologies such as Infotainment connected vehicles Cyber security OTA and Advanced Safety/ Body electronics.