Job Title:Senior Apache Flink Architect

Work Location: Forth Worth, TX (Hybrid)

Duration: Long-term Contract

Education/Experience Required:Bachelor's or Master's degree in Computer Science, Engineering, or a related field;Extensive experience with Apache Flink and a deep understanding of its internal workings, including stream processing concepts, event time, and watermarking.

Job Description :

As a Senior Apache Flink Architect, you will be responsible for designing and implementing advanced real-time streaming analytics solutions.
You will be at the forefront of designing systems that leverage real-time data to drive critical business decisions and actions.
Your expertise in Apache Flink will be pivotal in transforming raw data streams into actionable insights, enabling the organization to respond swiftly to emerging trends and patterns.
You will leverage Apache Flink's capabilities to deliver high-performance, scalable, and efficient data processing architectures that meet the dynamic needs of real-time analytics.

Responsibilities :

Design and Implement Streaming Solutions: Develop and maintain scalable and reliable streaming solutions using Apache Flink. Focus on handling both bounded and unbounded data streams, ensuring low latency and high throughput.
Complex Event Processing (CEP): Utilize Flink's CEP library for detecting patterns of events in a data stream. Design solutions that can identify and react to specific event patterns in real-time.
Real-time Analytics Dashboard Development: Build real-time analytics dashboards that provide valuable insights into business processes, IoT applications, and more. Ensure these dashboards reflect up-to-date data for informed decision-making.
Stream and Batch Data Integration: Utilize Flink's unified API to handle both streaming and batch processing, ensuring seamless integration and processing of data.
Machine Learning Integration: Leverage Flink ML for building predictive models and performing classification and clustering on streaming data.
Fault Tolerance and State Management: Ensure data safety and availability through effective state management and fault-tolerant design. Implement checkpoints and manage interactions with persistent storage systems.
Optimization and Performance Tuning: Utilize Flink's cost-based optimizer for stream and batch processing. Work on custom memory management and iterative computation to enhance performance.
Best Practices and Continuous Improvement: Stay updated with the latest trends and best practices in Apache Flink and streaming analytics. Continuously improve the solutions based on evolving business needs and technological advancements.

Skills & Qualifications :

Educational Background: Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
Experience: Minimum of 5-7 years of experience in data engineering, with a focus on real-time streaming analytics.
Specific Expertise: Extensive experience with Apache Flink and a deep understanding of its internal workings, including stream processing concepts, event time, and watermarking.
Technical Proficiency: Strong skills in Java/Scala/Python and familiarity with Flink's APIs (DataStream, DataSet, Table).
Systems Knowledge: Experience in building and optimizing large-scale distributed systems.
Machine Learning: Knowledge of integrating machine learning algorithms in a streaming context.
Analytical Skills: Strong problem-solving capabilities and analytical mindset.

Paladin Consulting

New Jobs

Ecommerce Developer

Apache Flink Architect