✍️ In which I finally get around to learning about Watermarks in #ApacheFlink
rmoff.net/2025/04/25/i...
#dataBS
rmoff.net/2025/04/25/i...
#dataBS
April 29, 2025 at 4:37 PM
✍️ In which I finally get around to learning about Watermarks in #ApacheFlink
rmoff.net/2025/04/25/i...
#dataBS
rmoff.net/2025/04/25/i...
#dataBS
Always nice to see
@gunnarmorling.dev presenting on Streaming Data Contracts With Debezium and #ApacheFlink at #FlinkForward #Jakarta
@gunnarmorling.dev presenting on Streaming Data Contracts With Debezium and #ApacheFlink at #FlinkForward #Jakarta
December 5, 2024 at 9:15 AM
Always nice to see
@gunnarmorling.dev presenting on Streaming Data Contracts With Debezium and #ApacheFlink at #FlinkForward #Jakarta
@gunnarmorling.dev presenting on Streaming Data Contracts With Debezium and #ApacheFlink at #FlinkForward #Jakarta
The kind of movie I go to the cinema for: starring #Debezium, #ApacheFlink, #Postgres, directed and presented by @gunnarmorling.dev . At Big Data Conference in one of Vilnius' cinemas! 😉
November 20, 2024 at 10:47 AM
The kind of movie I go to the cinema for: starring #Debezium, #ApacheFlink, #Postgres, directed and presented by @gunnarmorling.dev . At Big Data Conference in one of Vilnius' cinemas! 😉
🎉 this is why I blog :)
(and if _you_ want to understand #ApacheFlink watermarks better, check out rmoff.net/categories/w...)
(and if _you_ want to understand #ApacheFlink watermarks better, check out rmoff.net/categories/w...)
September 25, 2025 at 10:57 AM
🎉 this is why I blog :)
(and if _you_ want to understand #ApacheFlink watermarks better, check out rmoff.net/categories/w...)
(and if _you_ want to understand #ApacheFlink watermarks better, check out rmoff.net/categories/w...)
It's the formal opening of @FlinkFoward!
If you're here, the opening talks are starting!! #apacheflink #datastreaming #realtime!
If you're here, the opening talks are starting!! #apacheflink #datastreaming #realtime!
October 23, 2024 at 7:06 AM
It's the formal opening of @FlinkFoward!
If you're here, the opening talks are starting!! #apacheflink #datastreaming #realtime!
If you're here, the opening talks are starting!! #apacheflink #datastreaming #realtime!
On the home stretch with my latest blog post: an in-depth exploration of deploying #ApacheFlink jobs using the Flink Kubernetes operator, touching on aspects like building custom images, savepoint management, observability, UI access, and more. Be ready for some hefty YAML action very soon 🤓.
January 21, 2025 at 3:43 PM
On the home stretch with my latest blog post: an in-depth exploration of deploying #ApacheFlink jobs using the Flink Kubernetes operator, touching on aspects like building custom images, savepoint management, observability, UI access, and more. Be ready for some hefty YAML action very soon 🤓.
📝 Blogged: "This AI Agent Should Have Been a SQL Query"
Inspired by the title of a conference talk from a few years back, I ran a thought experiment: can we build agentic systems in the form of (streaming) SQL queries, running on top of #ApacheFlink?
👉 www.morling.dev/blog/this-ai...
Inspired by the title of a conference talk from a few years back, I ran a thought experiment: can we build agentic systems in the form of (streaming) SQL queries, running on top of #ApacheFlink?
👉 www.morling.dev/blog/this-ai...
June 18, 2025 at 3:28 PM
📝 Blogged: "This AI Agent Should Have Been a SQL Query"
Inspired by the title of a conference talk from a few years back, I ran a thought experiment: can we build agentic systems in the form of (streaming) SQL queries, running on top of #ApacheFlink?
👉 www.morling.dev/blog/this-ai...
Inspired by the title of a conference talk from a few years back, I ran a thought experiment: can we build agentic systems in the form of (streaming) SQL queries, running on top of #ApacheFlink?
👉 www.morling.dev/blog/this-ai...
🤫 Pssst… #apacheFlink 2.0 is _almost here_…
Dev mailing list discussion: lists.apache.org/thread/kjbhh...
Sneak peek at the release blog: github.com/apache/flink...
#dataBS
Dev mailing list discussion: lists.apache.org/thread/kjbhh...
Sneak peek at the release blog: github.com/apache/flink...
#dataBS
March 6, 2025 at 9:55 AM
🤫 Pssst… #apacheFlink 2.0 is _almost here_…
Dev mailing list discussion: lists.apache.org/thread/kjbhh...
Sneak peek at the release blog: github.com/apache/flink...
#dataBS
Dev mailing list discussion: lists.apache.org/thread/kjbhh...
Sneak peek at the release blog: github.com/apache/flink...
#dataBS
I’ve been saying this for a while: data streaming needs to be polyglot. I’m addressing this with Iron Functions: a WebAssembly-based runtime that enables writing #ApacheFlink transformations in several languages like TypeScript, Rust, and Go.
June 16, 2025 at 3:44 PM
I’ve been saying this for a while: data streaming needs to be polyglot. I’m addressing this with Iron Functions: a WebAssembly-based runtime that enables writing #ApacheFlink transformations in several languages like TypeScript, Rust, and Go.
🎉 #apacheFlink 2.0 has been released
💾 Download: flink.apache.org/downloads/
📖 Blog: flink.apache.org/2025/03/24/a...
#dataBS
💾 Download: flink.apache.org/downloads/
📖 Blog: flink.apache.org/2025/03/24/a...
#dataBS
nightlies.apache.org
March 24, 2025 at 9:10 AM
🎉 #apacheFlink 2.0 has been released
💾 Download: flink.apache.org/downloads/
📖 Blog: flink.apache.org/2025/03/24/a...
#dataBS
💾 Download: flink.apache.org/downloads/
📖 Blog: flink.apache.org/2025/03/24/a...
#dataBS
Another inspiring @utrechtjug.bsky.social meetup tonight. Learned about #ApacheFlink @gamussa.dev and @venkats.bsky.social told us about Gatherers. He warned us, “gain knowledge, but have the wisdom not to use all this knowledge”.
#devlife #java
#devlife #java
June 3, 2025 at 9:10 PM
Another inspiring @utrechtjug.bsky.social meetup tonight. Learned about #ApacheFlink @gamussa.dev and @venkats.bsky.social told us about Gatherers. He warned us, “gain knowledge, but have the wisdom not to use all this knowledge”.
#devlife #java
#devlife #java
Very cool end to the working week - just got my #ApacheFlink SQL pipeline writing realtime stream of data from UK Env Agency to Kafka topics, which are then materialised as Iceberg tables. Can't wait to poke into this some more next week—and blog the heck out of it too, ofc :D
#dataBS
#dataBS
March 28, 2025 at 6:07 PM
Very cool end to the working week - just got my #ApacheFlink SQL pipeline writing realtime stream of data from UK Env Agency to Kafka topics, which are then materialised as Iceberg tables. Can't wait to poke into this some more next week—and blog the heck out of it too, ofc :D
#dataBS
#dataBS
Wrapping my head around #FlinkCDC, what it is, how it interacts with #ApacheFlink —and what it means for a data engineer like me who lives in SQL and config for pipelines, not coding :)
#dataBS
#dataBS
December 2, 2024 at 5:57 PM
Wrapping my head around #FlinkCDC, what it is, how it interacts with #ApacheFlink —and what it means for a data engineer like me who lives in SQL and config for pipelines, not coding :)
#dataBS
#dataBS
I had a poke around Materialized Tables in #ApacheFlink and wrote it up from an end-user's perspective 👇🏻
rmoff.net/2026/04/28/m...
rmoff.net/2026/04/28/m...
Materialized Tables in Apache Flink
rmoff.net
April 29, 2026 at 9:04 AM
I had a poke around Materialized Tables in #ApacheFlink and wrote it up from an end-user's perspective 👇🏻
rmoff.net/2026/04/28/m...
rmoff.net/2026/04/28/m...
Really, really excited about speaking about data contracts at Flink Forward Asia in Jakarta 🇮🇩 in a few weeks. It's gonna be my first time to Indonesia, can't wait to meet with the data and dev community there! #Debezium #ApacheFlink
👉 asia.flink-forward.org/jakarta-2024/
👉 asia.flink-forward.org/jakarta-2024/
November 13, 2024 at 12:27 PM
Really, really excited about speaking about data contracts at Flink Forward Asia in Jakarta 🇮🇩 in a few weeks. It's gonna be my first time to Indonesia, can't wait to meet with the data and dev community there! #Debezium #ApacheFlink
👉 asia.flink-forward.org/jakarta-2024/
👉 asia.flink-forward.org/jakarta-2024/
It's #qcon London!!
We're here with a booth and talks on #ZeroTrust and #apacheflink.
Also meeting old friends Nf colleagues!
We're here with a booth and talks on #ZeroTrust and #apacheflink.
Also meeting old friends Nf colleagues!
April 7, 2025 at 11:26 AM
It's #qcon London!!
We're here with a booth and talks on #ZeroTrust and #apacheflink.
Also meeting old friends Nf colleagues!
We're here with a booth and talks on #ZeroTrust and #apacheflink.
Also meeting old friends Nf colleagues!
✍️ Blogged: Interesting Links - August 2025
🗂️ Topics cover #ApacheKafka, #ApacheIceberg, #ApacheFlink, Stream Processing, #DataEngineering, RDBMS, and some stuff that I just found generally interesting :)
👉 rmoff.net/2025/08/21/i...
#dataBS
🗂️ Topics cover #ApacheKafka, #ApacheIceberg, #ApacheFlink, Stream Processing, #DataEngineering, RDBMS, and some stuff that I just found generally interesting :)
👉 rmoff.net/2025/08/21/i...
#dataBS
Interesting links - August 2025
rmoff.net
August 22, 2025 at 9:03 AM
✍️ Blogged: Interesting Links - August 2025
🗂️ Topics cover #ApacheKafka, #ApacheIceberg, #ApacheFlink, Stream Processing, #DataEngineering, RDBMS, and some stuff that I just found generally interesting :)
👉 rmoff.net/2025/08/21/i...
#dataBS
🗂️ Topics cover #ApacheKafka, #ApacheIceberg, #ApacheFlink, Stream Processing, #DataEngineering, RDBMS, and some stuff that I just found generally interesting :)
👉 rmoff.net/2025/08/21/i...
#dataBS
Kicking off tonight's first #openSource data deep dive in #atlanta with a session from the one, the only, @sandonjacobs.bsky.social ! Using #apacheKafka, #apacheFlink, and #apacheIceberg to generate value!
March 4, 2025 at 11:39 PM
Kicking off tonight's first #openSource data deep dive in #atlanta with a session from the one, the only, @sandonjacobs.bsky.social ! Using #apacheKafka, #apacheFlink, and #apacheIceberg to generate value!
Have you ever found yourself thinking…Flink Watermarks…WTF?
🔥 This new tool might be for you :)
It's a hands-on, scrollytelling walkthrough of what watermarks in #ApacheFlink are, why they matter, and how to use them.
Try it out: flink-watermarks.wtf
#dataBS
🔥 This new tool might be for you :)
It's a hands-on, scrollytelling walkthrough of what watermarks in #ApacheFlink are, why they matter, and how to use them.
Try it out: flink-watermarks.wtf
#dataBS
Flink Watermarks…WTF?
Master Apache Flink watermarks with this interactive simulation. Learn what they are, why you need them, and how to configure them through hands-on examples.
flink-watermarks.wtf
October 20, 2025 at 1:44 PM
Have you ever found yourself thinking…Flink Watermarks…WTF?
🔥 This new tool might be for you :)
It's a hands-on, scrollytelling walkthrough of what watermarks in #ApacheFlink are, why they matter, and how to use them.
Try it out: flink-watermarks.wtf
#dataBS
🔥 This new tool might be for you :)
It's a hands-on, scrollytelling walkthrough of what watermarks in #ApacheFlink are, why they matter, and how to use them.
Try it out: flink-watermarks.wtf
#dataBS
#apacheflink 2.0 being on the horizon means breaking changes!
December 5, 2024 at 3:50 AM
#apacheflink 2.0 being on the horizon means breaking changes!
Log Aggregation with #ApacheFlink! #BigData #Analytics #DataScience #AI #MachineLearning #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #Java #ReactJS #GoLang #CloudComputing #Serverless #DataScientist #Linux #Programming #Coding #100DaysofCode
geni.us/Log-ApacheFl...
geni.us/Log-ApacheFl...
August 9, 2026 at 6:26 AM
@adipolak.bsky.social Director of Advocacy & Developer Experience Engineering at Confluent, shares key architecture strategies and practical solutions using #ApacheFlink to tackle streaming challenges in real-time #AI applications: qconsf.com/presentation...
#QConSF #SoftwareDevelopment
#QConSF #SoftwareDevelopment
November 20, 2024 at 2:04 AM
@adipolak.bsky.social Director of Advocacy & Developer Experience Engineering at Confluent, shares key architecture strategies and practical solutions using #ApacheFlink to tackle streaming challenges in real-time #AI applications: qconsf.com/presentation...
#QConSF #SoftwareDevelopment
#QConSF #SoftwareDevelopment
huh, turns out #apacheFlink has got a nice REST API, including for getting a list of jobs that are running. #TIL
📚 nightlies.apache.org/flink/flink-...
#dataBS
📚 nightlies.apache.org/flink/flink-...
#dataBS
December 5, 2024 at 11:04 PM
huh, turns out #apacheFlink has got a nice REST API, including for getting a list of jobs that are running. #TIL
📚 nightlies.apache.org/flink/flink-...
#dataBS
📚 nightlies.apache.org/flink/flink-...
#dataBS
FLIP-440 with ProcessTableFunction cwiki.apache.org/confluence/p... is probably the #apacheflink FLIP I've been most excited about since the Table API & SQL upgrade FLIP. Having the ability to build your own processing function with the benefits of the SQL ecosystem (query planner, optimizer) ❤️
FLIP-440: User-defined SQL operators / ProcessTableFunction (PTF) - Apache Flink - Apache Software Foundation
cwiki.apache.org
November 18, 2024 at 6:13 PM
FLIP-440 with ProcessTableFunction cwiki.apache.org/confluence/p... is probably the #apacheflink FLIP I've been most excited about since the Table API & SQL upgrade FLIP. Having the ability to build your own processing function with the benefits of the SQL ecosystem (query planner, optimizer) ❤️