#StreamProcessing
LightNews LightNews
vuminhhoa2.bsky.social
Time in Apache Flink: watermarks, idle partitions, state TTL and replay

Silently dropped late events, a quiet partition stalling every window, TTL on the wall clock, and processing-time timers that break deterministic replay.

#ApacheFlink #Streamprocessing #Watermarks
Time in Apache Flink: watermarks, idle partitions, state TTL and replay
Silently dropped late events, a quiet partition stalling every window, TTL on the wall clock, and processing-time timers that break deterministic replay.
vuminhhoa.com
October 30, 2026 at 6:48 PM
abu-bakar05.bsky.social
Processing continuous data streams with stateful computations, event-time windowing, and low-latency fault tolerance. Galgotias University prepares developers for real-time big data architecture! 🌊📊
#GalgotiasUniversity #StreamProcessing #ApacheFlink #DataEngineering
October 26, 2026 at 5:10 PM
qconferences.com
More sessions like this are lined up for QCon London 2027, April 13-16.

Find out more about QCon London 2027 here: buff.ly/bsgo9QV

#QConLondon #ApacheFluss #StreamProcessing
QCon London 2027 | Software Conference for Senior Developers
Gain actionable insights from leading software developers on emerging trends and practices at QCon London 2027, April 13-15.
buff.ly
October 21, 2026 at 8:01 PM
infoq.com
#Netflix is migrating 30,000+ streaming jobs to the open-source Apache Flink Autoscaler.

By moving from cluster-level to operator-level scaling, one internal team cut Flink compute costs by 58% ($1.1M/yr).

Full architecture details on #InfoQ 👉 buff.ly/RPTDh5Y

#ApacheFlink #StreamProcessing
September 10, 2026 at 8:20 PM
pingoru.bsky.social
⚠️ Fivetran is reporting a Incident since 08:50 UTC

"3rd Party: Some Microsoft Advertising connectors are failing with a "Report processing failed:…"

Affects: Microsoft Advertising

Live timeline → https://pingoru.io/providers/fivetran/incidents/3565207

#Fivetran #FivetranDown
Fivetran: 3rd Party: Some Microsoft Advertising connectors are failing with a "Report processing failed: (StreamProcessing)" error — June 7, 2026 · Pingoru
Fivetran incident on June 7, 2026: We have identified an issue where Microsoft Advertising connectors are failing with a "Report processing failed: (StreamProcessing)" excepti Started 8:50 AM UTC, resolved ongoing (● 5m). Affected: Microsoft Advertising.
pingoru.io
June 7, 2026 at 8:56 AM
rasros.bsky.social
Released v1 of Kumulant: a Kotlin/KMP library for streaming statistics.

It summarizes data streams without buffering, using sketches, histograms, and rolling moments with tunable concurrency.

github.com/eignex/kumul...

#Kotlin #KotlinMultiplatform #DataEngineering #StreamProcessing
GitHub - Eignex/kumulant: Fast, concurrency-friendly streaming statistics for Kotlin/KMP.
Fast, concurrency-friendly streaming statistics for Kotlin/KMP. - Eignex/kumulant
github.com
May 12, 2026 at 7:40 AM
softwaremill.com
Our experts, Krzysztof Grajek and Grzegorz Kocur, will be speaking at the Data Streaming Meetup in Kraków. View the agenda and join the event: meetup.com/krakow-kafka...

#ApacheKafka #DataStreaming #Confluent #Krk #Meetup #StreamProcessing #Rustlang #DevOps
Data Streaming Meetup , Thu, Apr 30, 2026, 6:00 PM | Meetup
Join us for a Data Streaming meetup on April 30th from 6:00pm in Kraków hosted by VirtusLab! *The talks will be presented in English.* 📍**Venue:** HEVRE, Beera Meiselsa 1
meetup.com
April 22, 2026 at 12:07 PM
datamechanic.pro
SQL Source to Fabric Delta Stream

www.linkedin.com/pulse/delta-...

#MicrosoftFabric #SQLServer #DataEngineering #RealTimeAnalytics #ChangeDataCapture #DeltaLake #AzureDataFactory #BusinessIntelligence #SQL #DataArchitecture #MicrosoftPartner #Lakehouse #StreamProcessing #ModernDataStack
April 12, 2026 at 7:00 PM
ruifspinto.bsky.social
Built streaming pipeline:
- Produced 49,416 Green Taxi Oct/25 trips to Redpanda in ~3s
- TUMBLE(5 min) : top zone PULocationID 74 with 15 trips
- SESSION(5 min gap) : longest session = 81 trips (PU 74)
- Flink → PostgreSQL via JDBC connector

#DataEngineering #ApacheFlink #Redpanda #StreamProcessing
March 21, 2026 at 9:28 AM
arifsolmaz.bsky.social
Stream processing that doesn't suck: RisingWave gives you sub-100ms end-to-end latency with Postgres-compatible SQL, native Iceberg support, and millions of events per second throughput in Rust.

🔗 https://github.com/risingwavelabs/risingwave

#StreamProcessing #Rust #DataEngineering
Stream processing that doesn't suck: RisingWave gives you sub-100ms end-to-end latency with Postgres
February 7, 2026 at 7:02 PM
hpgrahsl.bsky.social
Good news for #MongoDB / #ApacheKafka users who need to feed #Iceberg tables... 🧊 $iceberg now in private preview in #Atlas #StreamProcessing 👇

medium.com/towards-data...
November 11, 2025 at 11:59 AM
qconferences.com
Context, not compute, is the bottleneck for AI agents.

Adi Polak @Confluent shows how stream-native context engineering with Kafka & Flink builds memory layers that scale at QCon AI New York 2025.

🔗 Explore the session: bit.ly/4o8YjPC

#QConAI #AIAgents #StreamProcessing
October 30, 2025 at 12:16 PM
blainsmith.com
Filtering data in real time

lhcb-outreach.web.cern.ch/filtering-da...

#StreamProcessing #BigData #RealTime #CERN
Filtering data in real time
lhcb-outreach.web.cern.ch
October 22, 2025 at 10:53 AM
hncompanion.com
Technically, JSON River prioritizes speed by incrementally emitting strings during parsing. This design efficiently handles streaming data, though correctly parsing numbers in a real-time stream presents unique challenges for robustness. #StreamProcessing 3/6
October 14, 2025 at 7:00 PM
redpanda.com
▶️ WATCH: Alex Gallego on #NYSE Wired

Listen in on this episode of "Mixture of Experts" as John Furrier from SiliconANGLE & theCUBE chats with @joran.tigerbeetle.com from @tigerbeetle.com and our panda-in-chief @emaxerrno.bsky.social about the future of transactional #streamprocessing ⚡
Joran Dirk Greef, TigerBeetle & Alexander Gallego, Redpanda | theCUBE + NYSE Wired: MOE Series
YouTube video by SiliconANGLE theCUBE
www.youtube.com
September 30, 2025 at 3:53 PM
jugch.bsky.social
Join us in #Lucerne on Oct. 15 for an exciting talk by Viktor Gamov about #StreamProcessing with #Apache #Flink!

In this talk, Viktor will introduce #ApacheFlink, explain concepts like stateful and event-time stream processing, and explore its APIs and ecosystem.

www.jug.ch/html/events/...
Java User Group Switzerland: Event "Introduction to Stateful Stream Processing with Apache Flink"
Stream Processing has evolved quickly in a short time: only a few years ago, stream processing was mostly simple real-time aggregations with limited throughput and consistency. Today, many stream proc...
www.jug.ch
September 25, 2025 at 5:50 AM
pragmaticleader.bsky.social
Designing real-time data pipelines? Adi Polak's InfoQ talk covers essential streaming patterns:

🔵 Exactly-once processing
🔵 Stream joins
🔵 Dead Letter Queues

🔗 buff.ly/4EzMRVO

#DataStreaming #StreamProcessing #ApacheKafka #ApacheFlink #RealTimeData #DataEngineering
Custom Software & Website Development | AI Solutions
Looking for custom software or a new website that truly boosts your business? From intelligent software to responsive sites, I make sure you stand out online.
peerdh.com
June 29, 2025 at 1:19 PM
jameseastham.co.uk
Confused about streams vs databases? I break it down in this video! Understanding the difference is crucial for effective software architecture. Check it out: www.youtube.com/watch?v=m4S5... #softwarearchitecture #streamprocessing #databases
Streams are NOT databases! I repeat, streams are not databases! #softwarearchitecture
Streams aren't databases! Streams aren't databases! I could repeat this from now until the end of time. A stream should be a point of integration, not a long term persistence layer for your system. #serverless #eventdrivenarchitecture #softwarearchitecture #integration #messaging #asynccommunication #aws #software #softwareengineering
www.youtube.com
April 22, 2025 at 9:42 AM
senoritadeveloper.bsky.social
System Design Interview — Study Notes XII — Designing Data Intensive Applications Book Notes Chapter 11 #systemdesigninterview #interviewpreparation #streamprocessing senoritadeveloper.medium.com/system-desig...
System Design Interview — Study Notes XII — Designing Data Intensive Applications Book Notes
Notes on Concepts & Components to be used in a System Design Interview
senoritadeveloper.medium.com
April 12, 2025 at 4:05 PM
womanhattan.bsky.social
Motivating meetings today with customers in Paris. Across various industries customers are connecting with the power of stream processing.

#Paris #streamprocessing #apacheflink #flink #datastreaming
March 26, 2025 at 8:55 PM
gamussa.dev
My talk #StreamProcessing Smackdown: #KafkaStreams v Apache Flink" is coming to #CurrentLondon 2025

Which framework do you prefer?

- Challenging decision points?
- Use cases where one shines?
- Aspects you want covered?

Drop your thoughts below #dataBS #current25 @confluent.io
March 22, 2025 at 3:54 PM
redpanda.com
"In the future, you won't need to choose between #batch & #streamprocessing. We’ll just have a single unified data processing pipeline, w/ streaming or incremental semantics by default." - @sap1ens.com

Change Data Capture #CDC is a key player here—but how can we reach that reality as an industry?⬇️
Keynote: The Future of Data Streaming - Ubiquitous, Unified, Efficient
YouTube video by Redpanda Data
www.youtube.com
March 13, 2025 at 7:08 PM
mjsax.bsky.social
#StreamProcessing with @kafkastreams.bsky.social
February 7, 2025 at 5:43 PM
redpanda.com
🎓 JAN 16 MASTERCLASS TOMORROW: Stream processing with Flink and Redpanda

This 2-hr interactive session walks you through building a real-time #streamprocessing system for algorithmic trading using #Flink and Redpanda 🐾

No prior experience with Redpanda or Flink required!

Sign up to join👇
Stream Processing with Flink and Redpanda
Join Redpanda's expert-led session on stream processing with Apache Flink and Redpanda. Explore real-time data streaming, architecture best practices, and live demos. Sign up now!
www.redpanda.com
January 15, 2025 at 4:35 PM
redpanda.com
🎓 JANUARY MASTERCLASS: Stream processing with Flink and Redpanda

Feeling rusty after the holidays? This 2-hr interactive session walks you through building a real-time #streamprocessing system for algorithmic trading using #Flink and Redpanda 🐾

Sign up to join👇
Stream Processing with Flink and Redpanda
Join Redpanda's expert-led session on stream processing with Apache Flink and Redpanda. Explore real-time data streaming, architecture best practices, and live demos. Sign up now!
www.redpanda.com
January 8, 2025 at 4:35 PM