Flink with Datastreams API
kaavDallas, TX
Requirements for Resource: Proficient in writing and supporting both functional and non-functional aspects of Flink with Data Streams API.
Flink Functional Requirements:
- Expertise in Flink APIs (DataStream, Process functions, etc.).Competence in state management (checkpoints and savepoints) with local storage.
- Configuration of connectors like EventHub, Kafka, and MongoDB.Implementation of Flink API Aggregators.
- Handling watermarks for out-of-order events.
- Management of state using Azure Data Lake Storage (ADLS).Flink Non-Functional Requirements:
- Set up a private Flink cluster within a designated AKS environment.
- Configure both session-based and application-type deployments.
- Define and build nodes and slots.
- Manage and configure Job/Task Managers.
- Establish necessary connectors, e.g., external storage for the Flink Cluster.
- Configure heap memory and RocksDB for state management.
- Define and set up checkpoints and savepoints for state recovery.
- Enable Auto-Pilot capabilities.
- Integrate network resources, such as Azure EventHub and external databases like MongoDB.Implement integration with ArgoCD for job submissions.
- Install LTM agents for logging and Dynatrace agents for monitoring purposes.
- Provide access to the Flink Dashboard.
- Establish High Availability (HA) and Disaster Recovery (DR) configurations.
- Here is the exp level.10 years of hands-on design and java coding experience in back-end system development.5 years hands-on experience with Kafka, Flink, Cloud, Unit/Functional/Integration testing, SQL or kSQL, Java, Github Actions, Dynatrace, Code scanner, and MongoDB.
Additional details:
Delivery of a fully configured Confluent Cloud infrastructure with FLINK integration and automated CI/CD pipeline to deploy in all environments (Test, Stage, Prod).
Required Skills:
JavaBasic Qualification :Additional Skills :This is a high PRIORITY requisition. This is a PROACTIVE requisition
Background Check: NoDrug Screen : No
Matching similar jobs
Level
Senior L5
Location
Dallas, TX
Occupation
Software Developers
Industry
Computer Systems Design Services
Posted
today