#StreamProcessing
LightNews LightNews
vuminhhoa2.bsky.social
Time in Apache Flink: watermarks, idle partitions, state TTL and replay

Silently dropped late events, a quiet partition stalling every window, TTL on the wall clock, and processing-time timers that break deterministic replay.

#ApacheFlink #Streamprocessing #Watermarks
Time in Apache Flink: watermarks, idle partitions, state TTL and replay
Silently dropped late events, a quiet partition stalling every window, TTL on the wall clock, and processing-time timers that break deterministic replay.
vuminhhoa.com
October 30, 2026 at 6:48 PM
abu-bakar05.bsky.social
Processing continuous data streams with stateful computations, event-time windowing, and low-latency fault tolerance. Galgotias University prepares developers for real-time big data architecture! 🌊📊
#GalgotiasUniversity #StreamProcessing #ApacheFlink #DataEngineering
October 26, 2026 at 5:10 PM
qconferences.com
More sessions like this are lined up for QCon London 2027, April 13-16.

Find out more about QCon London 2027 here: buff.ly/bsgo9QV

#QConLondon #ApacheFluss #StreamProcessing
QCon London 2027 | Software Conference for Senior Developers
Gain actionable insights from leading software developers on emerging trends and practices at QCon London 2027, April 13-15.
buff.ly
October 21, 2026 at 8:01 PM
infoq.com
#Netflix is migrating 30,000+ streaming jobs to the open-source Apache Flink Autoscaler.

By moving from cluster-level to operator-level scaling, one internal team cut Flink compute costs by 58% ($1.1M/yr).

Full architecture details on #InfoQ 👉 buff.ly/RPTDh5Y

#ApacheFlink #StreamProcessing
September 10, 2026 at 8:20 PM
metadaddy-archive.bsky.social
Don't miss Rob Gibbon of @bigindustries presenting #Streamsets at Brussels stream processing meetup Jan 18, 18:30 https://www.meetup.com/StreamProcessing-be/events/234482615/
Login to Meetup | Meetup
Not a Meetup member yet? Log in and find groups that host online or in person events and meet people in your local community who share your interests.
www.meetup.com
November 15, 2024 at 12:03 AM
metadaddy-archive.bsky.social
'Running #Kafka in Production and #Streamsets’ meetup Jan 18, 6:30pm, Brussels w Rob Gibbon of @bigindustries https://www.meetup.com/StreamProcessing-be/events/234482615/
Login to Meetup | Meetup
Not a Meetup member yet? Log in and find groups that host online or in person events and meet people in your local community who share your interests.
www.meetup.com
November 15, 2024 at 12:00 AM
simplyblock.io
In this weeks episode of the Cloud Commute podcast, our host @noctarius.com talks with Gunnar Morling from #Decodable about the benefits of #SQL, how #CDC (change data capture) works and why Decodable uses #ApacheFlink as the base technology for its #StreamProcessing offering.

youtu.be/qrWBboOPY5U
EP08: Change Data Capture and Stream Processing in the Cloud - Gunnar Morling from Decodable
Gunnar Morling, from Decodable, a company simplifying the use of Apache Flink, talks about how to extract modifications from a database using change data cap...
youtu.be
April 26, 2024 at 7:03 AM
thedanicafine.bsky.social
Because of my background with streaming data, having the Flink-Iceberg sink is a great option. It means that you can easily build a pipeline to move my data from #apacheKafka, though #apacheFlink for #streamProcessing, and then off to #apacheIceberg.
December 10, 2024 at 3:28 PM
ruifspinto.bsky.social
Built streaming pipeline:
- Produced 49,416 Green Taxi Oct/25 trips to Redpanda in ~3s
- TUMBLE(5 min) : top zone PULocationID 74 with 15 trips
- SESSION(5 min gap) : longest session = 81 trips (PU 74)
- Flink → PostgreSQL via JDBC connector

#DataEngineering #ApacheFlink #Redpanda #StreamProcessing
March 21, 2026 at 9:28 AM
redpanda.com
▶️ WATCH: Alex Gallego on #NYSE Wired

Listen in on this episode of "Mixture of Experts" as John Furrier from SiliconANGLE & theCUBE chats with @joran.tigerbeetle.com from @tigerbeetle.com and our panda-in-chief @emaxerrno.bsky.social about the future of transactional #streamprocessing ⚡
Joran Dirk Greef, TigerBeetle & Alexander Gallego, Redpanda | theCUBE + NYSE Wired: MOE Series
YouTube video by SiliconANGLE theCUBE
www.youtube.com
September 30, 2025 at 3:53 PM
redpanda.com
"In the future, you won't need to choose between #batch & #streamprocessing. We’ll just have a single unified data processing pipeline, w/ streaming or incremental semantics by default." - @sap1ens.com

Change Data Capture #CDC is a key player here—but how can we reach that reality as an industry?⬇️
Keynote: The Future of Data Streaming - Ubiquitous, Unified, Efficient
YouTube video by Redpanda Data
www.youtube.com
March 13, 2025 at 7:08 PM
redpanda.com
🎓 JAN 16 MASTERCLASS TOMORROW: Stream processing with Flink and Redpanda

This 2-hr interactive session walks you through building a real-time #streamprocessing system for algorithmic trading using #Flink and Redpanda 🐾

No prior experience with Redpanda or Flink required!

Sign up to join👇
Stream Processing with Flink and Redpanda
Join Redpanda's expert-led session on stream processing with Apache Flink and Redpanda. Explore real-time data streaming, architecture best practices, and live demos. Sign up now!
www.redpanda.com
January 15, 2025 at 4:35 PM
redpanda.com
🎓 JANUARY MASTERCLASS: Stream processing with Flink and Redpanda

Feeling rusty after the holidays? This 2-hr interactive session walks you through building a real-time #streamprocessing system for algorithmic trading using #Flink and Redpanda 🐾

Sign up to join👇
Stream Processing with Flink and Redpanda
Join Redpanda's expert-led session on stream processing with Apache Flink and Redpanda. Explore real-time data streaming, architecture best practices, and live demos. Sign up now!
www.redpanda.com
January 8, 2025 at 4:35 PM
rasros.bsky.social
Released v1 of Kumulant: a Kotlin/KMP library for streaming statistics.

It summarizes data streams without buffering, using sketches, histograms, and rolling moments with tunable concurrency.

github.com/eignex/kumul...

#Kotlin #KotlinMultiplatform #DataEngineering #StreamProcessing
GitHub - Eignex/kumulant: Fast, concurrency-friendly streaming statistics for Kotlin/KMP.
Fast, concurrency-friendly streaming statistics for Kotlin/KMP. - Eignex/kumulant
github.com
May 12, 2026 at 7:40 AM
jugch.bsky.social
Join us in #Lucerne on Oct. 15 for an exciting talk by Viktor Gamov about #StreamProcessing with #Apache #Flink!

In this talk, Viktor will introduce #ApacheFlink, explain concepts like stateful and event-time stream processing, and explore its APIs and ecosystem.

www.jug.ch/html/events/...
Java User Group Switzerland: Event "Introduction to Stateful Stream Processing with Apache Flink"
Stream Processing has evolved quickly in a short time: only a few years ago, stream processing was mostly simple real-time aggregations with limited throughput and consistency. Today, many stream proc...
www.jug.ch
September 25, 2025 at 5:50 AM
berrettini.bsky.social
If #streamProcessing engines were implemented on the #beamvm they would have higher performances since distributed processing is native
@erlang_org @elixirlang @ApacheBeam @ApacheFlink @dataArtisans
November 26, 2024 at 4:37 PM
berrettini.bsky.social
Comparison of #EventSourcing with #StreamProcessing
@apachekafka will have transaction support!

infoq.com/news/2016/05/e…
November 26, 2024 at 4:17 PM
senoritadeveloper.bsky.social
System Design Interview — Study Notes XII — Designing Data Intensive Applications Book Notes Chapter 11 #systemdesigninterview #interviewpreparation #streamprocessing senoritadeveloper.medium.com/system-desig...
System Design Interview — Study Notes XII — Designing Data Intensive Applications Book Notes
Notes on Concepts & Components to be used in a System Design Interview
senoritadeveloper.medium.com
April 12, 2025 at 4:05 PM
blainsmith.com
Filtering data in real time

lhcb-outreach.web.cern.ch/filtering-da...

#StreamProcessing #BigData #RealTime #CERN
Filtering data in real time
lhcb-outreach.web.cern.ch
October 22, 2025 at 10:53 AM
softwaremill.com
Our experts, Krzysztof Grajek and Grzegorz Kocur, will be speaking at the Data Streaming Meetup in Kraków. View the agenda and join the event: meetup.com/krakow-kafka...

#ApacheKafka #DataStreaming #Confluent #Krk #Meetup #StreamProcessing #Rustlang #DevOps
Data Streaming Meetup , Thu, Apr 30, 2026, 6:00 PM | Meetup
Join us for a Data Streaming meetup on April 30th from 6:00pm in Kraków hosted by VirtusLab! *The talks will be presented in English.* 📍**Venue:** HEVRE, Beera Meiselsa 1
meetup.com
April 22, 2026 at 12:07 PM
hncompanion.com
Technically, JSON River prioritizes speed by incrementally emitting strings during parsing. This design efficiently handles streaming data, though correctly parsing numbers in a real-time stream presents unique challenges for robustness. #StreamProcessing 3/6
October 14, 2025 at 7:00 PM
arifsolmaz.bsky.social
Stream processing that doesn't suck: RisingWave gives you sub-100ms end-to-end latency with Postgres-compatible SQL, native Iceberg support, and millions of events per second throughput in Rust.

🔗 https://github.com/risingwavelabs/risingwave

#StreamProcessing #Rust #DataEngineering
Stream processing that doesn't suck: RisingWave gives you sub-100ms end-to-end latency with Postgres
February 7, 2026 at 7:02 PM
nielsberglund.bsky.social
Hey, I am new here. I live in Durban, South Africa. Software Architect Lead at Derivco. My team develops high-performing, AI-enabled iGaming systems.

Microsoft AI MVP. Interested in AI/ML, #GenAI, #AIAgents, #streamprocessing, #databases, #datacommunity.

Blogs at: nielsberglund.com
Niels Berglund | Niels Berglund
Blog by Niels Berglund
nielsberglund.com
November 17, 2024 at 8:53 AM
jameseastham.co.uk
Confused about streams vs databases? I break it down in this video! Understanding the difference is crucial for effective software architecture. Check it out: www.youtube.com/watch?v=m4S5... #softwarearchitecture #streamprocessing #databases
Streams are NOT databases! I repeat, streams are not databases! #softwarearchitecture
Streams aren't databases! Streams aren't databases! I could repeat this from now until the end of time. A stream should be a point of integration, not a long term persistence layer for your system. #serverless #eventdrivenarchitecture #softwarearchitecture #integration #messaging #asynccommunication #aws #software #softwareengineering
www.youtube.com
April 22, 2025 at 9:42 AM
gamussa.dev
My talk #StreamProcessing Smackdown: #KafkaStreams v Apache Flink" is coming to #CurrentLondon 2025

Which framework do you prefer?

- Challenging decision points?
- Use cases where one shines?
- Aspects you want covered?

Drop your thoughts below #dataBS #current25 @confluent.io
March 22, 2025 at 3:54 PM