🥃 Clustering Scotch whiskies with #ApacheFlink & @groovy.apache.org: Flink ML, hand-written K-means on Flink 2.3, then the hot loop as a Groovy GPU kernel with @tornadovm. Plus a caching trap & why Amdahl's law decides whether the GPU helps. @apache.org #groovylang groovy.apache.org/blog/groovy-...
November 2, 2026 at 3:54 AM
🥃 Clustering Scotch whiskies with #ApacheFlink & @groovy.apache.org: Flink ML, hand-written K-means on Flink 2.3, then the hot loop as a Groovy GPU kernel with @tornadovm. Plus a caching trap & why Amdahl's law decides whether the GPU helps. @apache.org #groovylang groovy.apache.org/blog/groovy-...
Time in Apache Flink: watermarks, idle partitions, state TTL and replay
Silently dropped late events, a quiet partition stalling every window, TTL on the wall clock, and processing-time timers that break deterministic replay.
#ApacheFlink #Streamprocessing #Watermarks
Silently dropped late events, a quiet partition stalling every window, TTL on the wall clock, and processing-time timers that break deterministic replay.
#ApacheFlink #Streamprocessing #Watermarks
Time in Apache Flink: watermarks, idle partitions, state TTL and replay
Silently dropped late events, a quiet partition stalling every window, TTL on the wall clock, and processing-time timers that break deterministic replay.
vuminhhoa.com
October 30, 2026 at 6:48 PM
Time in Apache Flink: watermarks, idle partitions, state TTL and replay
Silently dropped late events, a quiet partition stalling every window, TTL on the wall clock, and processing-time timers that break deterministic replay.
#ApacheFlink #Streamprocessing #Watermarks
Silently dropped late events, a quiet partition stalling every window, TTL on the wall clock, and processing-time timers that break deterministic replay.
#ApacheFlink #Streamprocessing #Watermarks
Exactly-once doesn’t come for free: Kafka, Flink and ClickHouse
Where an event pipeline loses or double-counts data: idempotency keys claimed too early, sink buffers outside checkpoints, and materialized views.
#Kafka #ApacheFlink #ClickHouse
Where an event pipeline loses or double-counts data: idempotency keys claimed too early, sink buffers outside checkpoints, and materialized views.
#Kafka #ApacheFlink #ClickHouse
Exactly-once doesn’t come for free: Kafka, Flink and ClickHouse
Where an event pipeline loses or double-counts data: idempotency keys claimed too early, sink buffers outside checkpoints, and materialized views.
vuminhhoa.com
October 28, 2026 at 1:40 AM
Exactly-once doesn’t come for free: Kafka, Flink and ClickHouse
Where an event pipeline loses or double-counts data: idempotency keys claimed too early, sink buffers outside checkpoints, and materialized views.
#Kafka #ApacheFlink #ClickHouse
Where an event pipeline loses or double-counts data: idempotency keys claimed too early, sink buffers outside checkpoints, and materialized views.
#Kafka #ApacheFlink #ClickHouse
Processing continuous data streams with stateful computations, event-time windowing, and low-latency fault tolerance. Galgotias University prepares developers for real-time big data architecture! 🌊📊
#GalgotiasUniversity #StreamProcessing #ApacheFlink #DataEngineering
#GalgotiasUniversity #StreamProcessing #ApacheFlink #DataEngineering
October 26, 2026 at 5:10 PM
Processing continuous data streams with stateful computations, event-time windowing, and low-latency fault tolerance. Galgotias University prepares developers for real-time big data architecture! 🌊📊
#GalgotiasUniversity #StreamProcessing #ApacheFlink #DataEngineering
#GalgotiasUniversity #StreamProcessing #ApacheFlink #DataEngineering
Pinterest introduced event-time-based partition finalization, combining #ApacheFlink & #ApacheIceberg metadata to publish non-regressing watermarks that help downstream jobs determine when ingested data is sufficiently complete to process.
🔗 Learn more: buff.ly/2I2WQEh
#DataEngineering #InfoQ
🔗 Learn more: buff.ly/2I2WQEh
#DataEngineering #InfoQ
October 23, 2026 at 10:49 AM
Pinterest introduced event-time-based partition finalization, combining #ApacheFlink & #ApacheIceberg metadata to publish non-regressing watermarks that help downstream jobs determine when ingested data is sufficiently complete to process.
🔗 Learn more: buff.ly/2I2WQEh
#DataEngineering #InfoQ
🔗 Learn more: buff.ly/2I2WQEh
#DataEngineering #InfoQ
My Advanced Apache Flink course includes a chapter on profiling, where I show various performance issues and their associated flamegraphs.
#DataStreaming #ApacheFlink
#DataStreaming #ApacheFlink
October 2, 2026 at 4:05 PM
My Advanced Apache Flink course includes a chapter on profiling, where I show various performance issues and their associated flamegraphs.
#DataStreaming #ApacheFlink
#DataStreaming #ApacheFlink
#Netflix is migrating 30,000+ streaming jobs to the open-source Apache Flink Autoscaler.
By moving from cluster-level to operator-level scaling, one internal team cut Flink compute costs by 58% ($1.1M/yr).
Full architecture details on #InfoQ 👉 buff.ly/RPTDh5Y
#ApacheFlink #StreamProcessing
By moving from cluster-level to operator-level scaling, one internal team cut Flink compute costs by 58% ($1.1M/yr).
Full architecture details on #InfoQ 👉 buff.ly/RPTDh5Y
#ApacheFlink #StreamProcessing
September 10, 2026 at 8:20 PM
#Netflix is migrating 30,000+ streaming jobs to the open-source Apache Flink Autoscaler.
By moving from cluster-level to operator-level scaling, one internal team cut Flink compute costs by 58% ($1.1M/yr).
Full architecture details on #InfoQ 👉 buff.ly/RPTDh5Y
#ApacheFlink #StreamProcessing
By moving from cluster-level to operator-level scaling, one internal team cut Flink compute costs by 58% ($1.1M/yr).
Full architecture details on #InfoQ 👉 buff.ly/RPTDh5Y
#ApacheFlink #StreamProcessing
Flink Autoscaler Netflix: el ahorro de USD 1,1M al año
¿Cómo bajó Netflix un 58% su gasto en streaming? El Flink Autoscaler Netflix cambia el escalado por clúster por decisiones por operador, con ahorro real...
#flink #netflix #apacheflink #autoscaling #streaming
¿Cómo bajó Netflix un 58% su gasto en streaming? El Flink Autoscaler Netflix cambia el escalado por clúster por decisiones por operador, con ahorro real...
#flink #netflix #apacheflink #autoscaling #streaming
Flink Autoscaler Netflix: el ahorro de USD 1,1M al año
Netflix reemplaza su autoscaler cluster-level por uno open source por operador en 30.000 jobs de Flink y un equipo ahorró 58% en cómputo.
donweb.news
September 8, 2026 at 11:34 AM
Flink Autoscaler Netflix: el ahorro de USD 1,1M al año
¿Cómo bajó Netflix un 58% su gasto en streaming? El Flink Autoscaler Netflix cambia el escalado por clúster por decisiones por operador, con ahorro real...
#flink #netflix #apacheflink #autoscaling #streaming
¿Cómo bajó Netflix un 58% su gasto en streaming? El Flink Autoscaler Netflix cambia el escalado por clúster por decisiones por operador, con ahorro real...
#flink #netflix #apacheflink #autoscaling #streaming
1/2 We are looking for more people to work on #ApacheKafka and #ApacheFlink at Cloudera. So, if you want to work with me in the same team 😜, feel free to check them out and apply. The preferred location is LATAM. But as far as I heard, other regions might be considered as well.
August 12, 2026 at 8:46 PM
1/2 We are looking for more people to work on #ApacheKafka and #ApacheFlink at Cloudera. So, if you want to work with me in the same team 😜, feel free to check them out and apply. The preferred location is LATAM. But as far as I heard, other regions might be considered as well.
Log Aggregation with #ApacheFlink! #BigData #Analytics #DataScience #AI #MachineLearning #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #Java #ReactJS #GoLang #CloudComputing #Serverless #DataScientist #Linux #Programming #Coding #100DaysofCode
geni.us/Log-ApacheFl...
geni.us/Log-ApacheFl...
August 9, 2026 at 6:26 AM
In this weeks episode of the Cloud Commute podcast, our host @noctarius.com talks with Gunnar Morling from #Decodable about the benefits of #SQL, how #CDC (change data capture) works and why Decodable uses #ApacheFlink as the base technology for its #StreamProcessing offering.
youtu.be/qrWBboOPY5U
youtu.be/qrWBboOPY5U
EP08: Change Data Capture and Stream Processing in the Cloud - Gunnar Morling from Decodable
Gunnar Morling, from Decodable, a company simplifying the use of Apache Flink, talks about how to extract modifications from a database using change data cap...
youtu.be
April 26, 2024 at 7:03 AM
In this weeks episode of the Cloud Commute podcast, our host @noctarius.com talks with Gunnar Morling from #Decodable about the benefits of #SQL, how #CDC (change data capture) works and why Decodable uses #ApacheFlink as the base technology for its #StreamProcessing offering.
youtu.be/qrWBboOPY5U
youtu.be/qrWBboOPY5U
Schema proliferation builds slowly and gets expensive fast.
The Alternative❓ Discriminator-based schema consolidation - reduces schema count, simplifies downstream consumption, and makes schema evolution manageable.
🔗 #InfoQ article ⇨ bit.ly/4uFmBnM
#Java #ApacheKafka #ApacheFlink
The Alternative❓ Discriminator-based schema consolidation - reduces schema count, simplifies downstream consumption, and makes schema evolution manageable.
🔗 #InfoQ article ⇨ bit.ly/4uFmBnM
#Java #ApacheKafka #ApacheFlink
May 28, 2026 at 11:12 AM
Schema proliferation builds slowly and gets expensive fast.
The Alternative❓ Discriminator-based schema consolidation - reduces schema count, simplifies downstream consumption, and makes schema evolution manageable.
🔗 #InfoQ article ⇨ bit.ly/4uFmBnM
#Java #ApacheKafka #ApacheFlink
The Alternative❓ Discriminator-based schema consolidation - reduces schema count, simplifies downstream consumption, and makes schema evolution manageable.
🔗 #InfoQ article ⇨ bit.ly/4uFmBnM
#Java #ApacheKafka #ApacheFlink
Atlassian introduced Lithium - an in-house #ETL platform designed to meet the requirements of dynamic data movement.
📢 InfoQ spoke with Niraj Mishra, Principal Engineer, about Lithium’s implementation and future.
🔗 Read more: bit.ly/40yb77E
#DataPipelines #ApacheKafka #ApacheFlink #InfoQ
📢 InfoQ spoke with Niraj Mishra, Principal Engineer, about Lithium’s implementation and future.
🔗 Read more: bit.ly/40yb77E
#DataPipelines #ApacheKafka #ApacheFlink #InfoQ
January 31, 2025 at 11:16 AM
Atlassian introduced Lithium - an in-house #ETL platform designed to meet the requirements of dynamic data movement.
📢 InfoQ spoke with Niraj Mishra, Principal Engineer, about Lithium’s implementation and future.
🔗 Read more: bit.ly/40yb77E
#DataPipelines #ApacheKafka #ApacheFlink #InfoQ
📢 InfoQ spoke with Niraj Mishra, Principal Engineer, about Lithium’s implementation and future.
🔗 Read more: bit.ly/40yb77E
#DataPipelines #ApacheKafka #ApacheFlink #InfoQ
Real-time AI agents need more than a model — they need live data, memory, and instant decisioning. Alex Campos from Ververica + TiDB at SCaiLE Europe: https://ow.ly/WG2h50Zn92G
#AgenticAI #ApacheFlink #TiDB
#AgenticAI #ApacheFlink #TiDB
July 14, 2026 at 10:31 AM
Real-time AI agents need more than a model — they need live data, memory, and instant decisioning. Alex Campos from Ververica + TiDB at SCaiLE Europe: https://ow.ly/WG2h50Zn92G
#AgenticAI #ApacheFlink #TiDB
#AgenticAI #ApacheFlink #TiDB
#StardewValley conversations powered by LLM, #ApacheKafka and #ApacheFlink. Admittedly still shallow and I'm working on a better visualisation - the map gets too busy with lots of conversations at once...
Also, my villagers are quite impolite - walking away while still talking!
Also, my villagers are quite impolite - walking away while still talking!
May 15, 2025 at 9:03 AM
#StardewValley conversations powered by LLM, #ApacheKafka and #ApacheFlink. Admittedly still shallow and I'm working on a better visualisation - the map gets too busy with lots of conversations at once...
Also, my villagers are quite impolite - walking away while still talking!
Also, my villagers are quite impolite - walking away while still talking!
Data analytics for everyday life!
Streaming, enhancing and aggregating data from my very biased BlueSky feed (#NeedsMoreCats) 🐱
#ApacheKafka → #ApacheFlink (with calls to LLM for vibes & tags) → #Tableflow → #ApacheIceberg → #Trino → #Superset
Streaming, enhancing and aggregating data from my very biased BlueSky feed (#NeedsMoreCats) 🐱
#ApacheKafka → #ApacheFlink (with calls to LLM for vibes & tags) → #Tableflow → #ApacheIceberg → #Trino → #Superset
April 15, 2025 at 3:10 PM
Data analytics for everyday life!
Streaming, enhancing and aggregating data from my very biased BlueSky feed (#NeedsMoreCats) 🐱
#ApacheKafka → #ApacheFlink (with calls to LLM for vibes & tags) → #Tableflow → #ApacheIceberg → #Trino → #Superset
Streaming, enhancing and aggregating data from my very biased BlueSky feed (#NeedsMoreCats) 🐱
#ApacheKafka → #ApacheFlink (with calls to LLM for vibes & tags) → #Tableflow → #ApacheIceberg → #Trino → #Superset
🛤️ Heading back to Vienna after busy time at PyCon Austria 🇦🇹!
But the day is not over and I'm looking forward for an evening with a curious crowd at the #ApacheKafka x #ApacheFlink meetup, chatting about architecture, DevOps, data streaming, and what not!
But the day is not over and I'm looking forward for an evening with a curious crowd at the #ApacheKafka x #ApacheFlink meetup, chatting about architecture, DevOps, data streaming, and what not!
April 7, 2025 at 11:02 AM
🛤️ Heading back to Vienna after busy time at PyCon Austria 🇦🇹!
But the day is not over and I'm looking forward for an evening with a curious crowd at the #ApacheKafka x #ApacheFlink meetup, chatting about architecture, DevOps, data streaming, and what not!
But the day is not over and I'm looking forward for an evening with a curious crowd at the #ApacheKafka x #ApacheFlink meetup, chatting about architecture, DevOps, data streaming, and what not!
The kind of movie I go to the cinema for: starring #Debezium, #ApacheFlink, #Postgres, directed and presented by @gunnarmorling.dev . At Big Data Conference in one of Vilnius' cinemas! 😉
November 20, 2024 at 10:47 AM
The kind of movie I go to the cinema for: starring #Debezium, #ApacheFlink, #Postgres, directed and presented by @gunnarmorling.dev . At Big Data Conference in one of Vilnius' cinemas! 😉
Going to #london next week to dive into all things #apacheKafka, #apacheFlink, and #apacheIceberg?
Keep the conversation going at an #openSource meetup on May 21 with presenters JB Onofré and Eric Maynard!
Register below 👇
lu.ma/whptau71
Keep the conversation going at an #openSource meetup on May 21 with presenters JB Onofré and Eric Maynard!
Register below 👇
lu.ma/whptau71
Open Source Data Deep Dive: London · Luma
Open Source Data Deep Dives are back in London!
Join us for an evening of networking as we share some of the coolest and innovative use cases of the Iceberg…
lu.ma
May 14, 2025 at 8:15 AM
Going to #london next week to dive into all things #apacheKafka, #apacheFlink, and #apacheIceberg?
Keep the conversation going at an #openSource meetup on May 21 with presenters JB Onofré and Eric Maynard!
Register below 👇
lu.ma/whptau71
Keep the conversation going at an #openSource meetup on May 21 with presenters JB Onofré and Eric Maynard!
Register below 👇
lu.ma/whptau71
Ever wanted a “Do Not Disturb” sign for Zoom calls?
Join me at #PyConDE to build your own On-Air sign with #python, #apacheKafka, #apacheFlink, and #apacheIceberg! We’ll capture Zoom + camera events, process them in real-time, and control a sign with a #raspberryPi.
2025.pycon.de/talks/P9GRZU/
Join me at #PyConDE to build your own On-Air sign with #python, #apacheKafka, #apacheFlink, and #apacheIceberg! We’ll capture Zoom + camera events, process them in real-time, and control a sign with a #raspberryPi.
2025.pycon.de/talks/P9GRZU/
Quiet on Set: Building an On-Air Sign with Open Source Technologies
Join PyCon DE & PyData 2025 in Darmstadt (Frankfurt), April 23-25! Germany’s largest Python and Data Science conference with talks, workshops, and community events like DjangoGirls and sprints. Be par...
2025.pycon.de
April 21, 2025 at 4:28 PM
Ever wanted a “Do Not Disturb” sign for Zoom calls?
Join me at #PyConDE to build your own On-Air sign with #python, #apacheKafka, #apacheFlink, and #apacheIceberg! We’ll capture Zoom + camera events, process them in real-time, and control a sign with a #raspberryPi.
2025.pycon.de/talks/P9GRZU/
Join me at #PyConDE to build your own On-Air sign with #python, #apacheKafka, #apacheFlink, and #apacheIceberg! We’ll capture Zoom + camera events, process them in real-time, and control a sign with a #raspberryPi.
2025.pycon.de/talks/P9GRZU/
2. Streaming. Using #apacheKafka or #apachePulsar to stream your data? Or maybe you're diving into stream processing with #kafkaStreams, #apacheFlink, or #apacheSpark. Whatever it is that you're streaming, we want to hear from you!
April 18, 2025 at 2:57 PM
2. Streaming. Using #apacheKafka or #apachePulsar to stream your data? Or maybe you're diving into stream processing with #kafkaStreams, #apacheFlink, or #apacheSpark. Whatever it is that you're streaming, we want to hear from you!
We had three great talks covering a variety of topics:
🪙 @sandonjacobs.bsky.social's talk on where #apacheIceberg fits into #realtime systems alongside #apacheKafka and #apacheFlink
🪙 @sandonjacobs.bsky.social's talk on where #apacheIceberg fits into #realtime systems alongside #apacheKafka and #apacheFlink
March 5, 2025 at 1:05 PM
We had three great talks covering a variety of topics:
🪙 @sandonjacobs.bsky.social's talk on where #apacheIceberg fits into #realtime systems alongside #apacheKafka and #apacheFlink
🪙 @sandonjacobs.bsky.social's talk on where #apacheIceberg fits into #realtime systems alongside #apacheKafka and #apacheFlink
Kicking off tonight's first #openSource data deep dive in #atlanta with a session from the one, the only, @sandonjacobs.bsky.social ! Using #apacheKafka, #apacheFlink, and #apacheIceberg to generate value!
March 4, 2025 at 11:39 PM
Kicking off tonight's first #openSource data deep dive in #atlanta with a session from the one, the only, @sandonjacobs.bsky.social ! Using #apacheKafka, #apacheFlink, and #apacheIceberg to generate value!
Officially excited to head to #atlanta next week! ✈️
First up, our #openSource data deep dive! Join me, @sandonjacobs.bsky.social , and Andrew Madson as we take a look at #apacheIceberg, a real-time stack with #apacheKafka and #apacheFlink, and #AI. There's still time to sign up 👇
lu.ma/glbczpnb
First up, our #openSource data deep dive! Join me, @sandonjacobs.bsky.social , and Andrew Madson as we take a look at #apacheIceberg, a real-time stack with #apacheKafka and #apacheFlink, and #AI. There's still time to sign up 👇
lu.ma/glbczpnb
Open Source Data Deep Dive: Atlanta · Luma
Buckle up, we're taking the Open Source Data Deep Dives series on the road. First stop: Atlanta!
Join us for an evening of networking as we share some of the…
lu.ma
February 26, 2025 at 4:26 PM
Officially excited to head to #atlanta next week! ✈️
First up, our #openSource data deep dive! Join me, @sandonjacobs.bsky.social , and Andrew Madson as we take a look at #apacheIceberg, a real-time stack with #apacheKafka and #apacheFlink, and #AI. There's still time to sign up 👇
lu.ma/glbczpnb
First up, our #openSource data deep dive! Join me, @sandonjacobs.bsky.social , and Andrew Madson as we take a look at #apacheIceberg, a real-time stack with #apacheKafka and #apacheFlink, and #AI. There's still time to sign up 👇
lu.ma/glbczpnb