Kafka Admin / Developer
samprasoftRichardson, TX
C2H Kafka Resource
Location: Richardson, TX or Buffalo Grove, IL (Must sit onsite 2-3 days / wk)
Skills SetAdministration of Confluent Kafka infrastructure Kafka brokers, Producer, Consumers, zookeepers, Kafka connect, schema registry, KsqlDB, Kafka streams. Monitoring and setup using Prometheus, Grafana and confluent control Centre Scripting using Shell and Python Infrastructure as Code- TerraformCI/CD using Jenkins Knowledge on GCP/AWS/Azure Cloud Managed/Custom Kafka connectors configuration Kafka development experience with Microservices/java/j2ee frameworks.
Roles and Responsibilities:
- Leading and Architecting Confluent Kafka application
- Creating Kafka topics and providing required access to the Producer Application to publish messages to the Kafka topic.
- Providing appropriate access to the consumer group to consumer messages from Kafka topic for Consumer Application.
- Diagnosing, Troubleshooting, and solving Kafka issues and maintaining the documentation for the same.
- Developing middleware integration solution for enrichment or transformation
- Deploying Source and Sink connectors on self-managed Virtual Machines (VM) based on the client’s needs
- Build data pipelines with Kafka connect/connectors to deploy and support Kafka Data stream processing.
- Setup monitoring tool Prometheus, Grafana and confluent control Centre
- Configure Grafana dashboard to monitor Confluent Kafka cluster and providing access to the requested users.
- Setup alerts for Kafka Consumer Lags and other issues.
- Responsible for implementation and ongoing administration of Confluent Kafka infrastructure.
Matching similar jobs
Level
Mid L4
Location
Richardson, TX
Occupation
Computer Systems Engineers/Architects
Industry
Computer Systems Design Services
Posted
7 days ago