[new blog post]
DBSP: Automatic Incremental View Maintenance for Rich Query Languages
muratbuffalo.blogspot.com/2024/11/dbsp...
DBSP: Automatic Incremental View Maintenance for Rich Query Languages
muratbuffalo.blogspot.com/2024/11/dbsp...
DBSP: Automatic Incremental View Maintenance for Rich Query Languages
Incremental computation represents a transformative (!) approach to data processing. Instead of recomputing everything when your input chang...
muratbuffalo.blogspot.com
November 20, 2024 at 2:17 AM
[new blog post]
DBSP: Automatic Incremental View Maintenance for Rich Query Languages
muratbuffalo.blogspot.com/2024/11/dbsp...
DBSP: Automatic Incremental View Maintenance for Rich Query Languages
muratbuffalo.blogspot.com/2024/11/dbsp...
*writes dbsp program by hand*
dbsp - Rust
The `dbsp` crate implements a computational engine for continuous analysis of changing data. With DBSP, a programmer writes code in terms of computations on a complete data set, but DBSP implements i...
docs.rs
December 10, 2024 at 1:45 AM
*writes dbsp program by hand*
For anyone else trying to catch up on DBSP, my recommended flow of learning is:
1. Watch the talk: www.youtube.com/watch?v=omOH... (h/t @wslim.bsky.social)
2. Read the spec/book: mihaibudiu.github.io/work/dbsp-sp... (h/t @avi.im)
3. Read the VLDB paper
List is ordered by assumed knowledge of reader
1. Watch the talk: www.youtube.com/watch?v=omOH... (h/t @wslim.bsky.social)
2. Read the spec/book: mihaibudiu.github.io/work/dbsp-sp... (h/t @avi.im)
3. Read the VLDB paper
List is ordered by assumed knowledge of reader
August 19, 2025 at 9:21 PM
For anyone else trying to catch up on DBSP, my recommended flow of learning is:
1. Watch the talk: www.youtube.com/watch?v=omOH... (h/t @wslim.bsky.social)
2. Read the spec/book: mihaibudiu.github.io/work/dbsp-sp... (h/t @avi.im)
3. Read the VLDB paper
List is ordered by assumed knowledge of reader
1. Watch the talk: www.youtube.com/watch?v=omOH... (h/t @wslim.bsky.social)
2. Read the spec/book: mihaibudiu.github.io/work/dbsp-sp... (h/t @avi.im)
3. Read the VLDB paper
List is ordered by assumed knowledge of reader
STICKERS Credits !!!
1) @torpordust.bsky.social
2) @christelled.bsky.social
3) DBSP
4) @celiahousset.bsky.social
5) Brecht Vandenbroucke
6) Tarmaz
7) mysterious guy
8) @mariespenale.bsky.social
9) unknown
10) @elmarraudino.bsky.social
11) @percevalrobin.bsky.social
1) @torpordust.bsky.social
2) @christelled.bsky.social
3) DBSP
4) @celiahousset.bsky.social
5) Brecht Vandenbroucke
6) Tarmaz
7) mysterious guy
8) @mariespenale.bsky.social
9) unknown
10) @elmarraudino.bsky.social
11) @percevalrobin.bsky.social
July 16, 2025 at 4:29 PM
STICKERS Credits !!!
1) @torpordust.bsky.social
2) @christelled.bsky.social
3) DBSP
4) @celiahousset.bsky.social
5) Brecht Vandenbroucke
6) Tarmaz
7) mysterious guy
8) @mariespenale.bsky.social
9) unknown
10) @elmarraudino.bsky.social
11) @percevalrobin.bsky.social
1) @torpordust.bsky.social
2) @christelled.bsky.social
3) DBSP
4) @celiahousset.bsky.social
5) Brecht Vandenbroucke
6) Tarmaz
7) mysterious guy
8) @mariespenale.bsky.social
9) unknown
10) @elmarraudino.bsky.social
11) @percevalrobin.bsky.social
Ok, y'all. This took me several weeks and a ton of help from @frankmcsherry.bsky.social and @lalithsuresh.bsky.social. I dug into timely dataflow, differential dataflow, and DBSP to get you up to speed on IVM engines and materialized views. Enjoy!
Everything You Need to Know About Incremental View Maintenance
An overview of incremental view maintenance, why it’s useful, and how you can implement it.
materializedview.io
April 18, 2025 at 6:30 PM
Ok, y'all. This took me several weeks and a ton of help from @frankmcsherry.bsky.social and @lalithsuresh.bsky.social. I dug into timely dataflow, differential dataflow, and DBSP to get you up to speed on IVM engines and materialized views. Enjoy!
There’s a fascinating algorithm called DBSP that single-handedly managed to combine streaming and batch systems and solve a decades-old database efficiency problem. Lalith Suresh joined me to explain the core of how it works: 😊
youtu.be/CyvnH8OUCUA
youtu.be/CyvnH8OUCUA
Making Materialized Views Actually Fast with DBSP (with Lalith Suresh)
YouTube video by Developer Voices
youtu.be
July 8, 2026 at 3:27 PM
There’s a fascinating algorithm called DBSP that single-handedly managed to combine streaming and batch systems and solve a decades-old database efficiency problem. Lalith Suresh joined me to explain the core of how it works: 😊
youtu.be/CyvnH8OUCUA
youtu.be/CyvnH8OUCUA
🚀 Mihai Budiu will be giving a talk about DBSP, the IVM foundation powering @feldera.bsky.social at the CMU Database Group seminar on Monday, May 12, 2025, @ 12:00 pm EDT.
Zoom link below. 👇
db.cs.cmu.edu/events/dbsp-...
#databs #feldera #ivm
Zoom link below. 👇
db.cs.cmu.edu/events/dbsp-...
#databs #feldera #ivm
DBSP: Incremental Computation on Streams and Its Applications to Databases - Carnegie Mellon Database Group
We describe DBSP, a framework for incremental computation. Incremental computations repeatedly evaluate... Read More +
db.cs.cmu.edu
May 10, 2025 at 2:24 PM
🚀 Mihai Budiu will be giving a talk about DBSP, the IVM foundation powering @feldera.bsky.social at the CMU Database Group seminar on Monday, May 12, 2025, @ 12:00 pm EDT.
Zoom link below. 👇
db.cs.cmu.edu/events/dbsp-...
#databs #feldera #ivm
Zoom link below. 👇
db.cs.cmu.edu/events/dbsp-...
#databs #feldera #ivm
Happy to see an article on DBSP/Feldera on one of my favorite distributed systems blogs.
Thanks for the shoutout @muratdemirbas.bsky.social!
Thanks for the shoutout @muratdemirbas.bsky.social!
[new blog post]
DBSP: Automatic Incremental View Maintenance for Rich Query Languages
muratbuffalo.blogspot.com/2024/11/dbsp...
DBSP: Automatic Incremental View Maintenance for Rich Query Languages
muratbuffalo.blogspot.com/2024/11/dbsp...
DBSP: Automatic Incremental View Maintenance for Rich Query Languages
Incremental computation represents a transformative (!) approach to data processing. Instead of recomputing everything when your input chang...
muratbuffalo.blogspot.com
November 20, 2024 at 4:26 AM
Happy to see an article on DBSP/Feldera on one of my favorite distributed systems blogs.
Thanks for the shoutout @muratdemirbas.bsky.social!
Thanks for the shoutout @muratdemirbas.bsky.social!
I don't think so. They just didn't really improve the game. Dbsp is still just diamond and pearl. Yakuza 3 kiwami changes the core of what was Yakuza 3.
February 10, 2026 at 4:02 PM
I don't think so. They just didn't really improve the game. Dbsp is still just diamond and pearl. Yakuza 3 kiwami changes the core of what was Yakuza 3.
WCOJ meets DBSP. This is the post I wanted to get at when starting the series. finnvolkel.com/wcoj-wcoj-me...
WCOJ - WCOJ meets DBSP · Finn Völkel
finnvolkel.com
January 3, 2026 at 11:11 AM
WCOJ meets DBSP. This is the post I wanted to get at when starting the series. finnvolkel.com/wcoj-wcoj-me...
January 14, 2025 at 12:23 PM
"As we move towards high-latency storage" 👀
[dbsp] schedule circuits using tokio. by ryzhyk · Pull Request #3300 · feldera/feldera
The DBSP scheduler used to run operators one by one, executing each operator to completion before picking the next runnable operator. This is inefficient for I/O intensive operators, as it doesn&#...
github.com
January 14, 2025 at 12:44 AM
"As we move towards high-latency storage" 👀
It's very funny that there's a Health music video that's just "here's a bunch of cut up cutscenes from C&C Red Alert 2" www.youtube.com/watch?v=dbSP...
HEALTH :: DEMIGODS
YouTube video by HEALTH
www.youtube.com
March 4, 2026 at 9:26 AM
It's very funny that there's a Health music video that's just "here's a bunch of cut up cutscenes from C&C Red Alert 2" www.youtube.com/watch?v=dbSP...
There is also the SIGMOD paper and upcoming VLDB journal paper from the Feldera. The SIGMOD paper is here: www.feldera.com/blog/sigmod-...
DBSP in ACM SIGMOD Research Highlights
The DBSP paper receives the ACM SIGMOD 2024 Research Highlights Award
www.feldera.com
April 9, 2025 at 5:24 PM
There is also the SIGMOD paper and upcoming VLDB journal paper from the Feldera. The SIGMOD paper is here: www.feldera.com/blog/sigmod-...
Feldera SQL is now Turing Complete, with recursive SQL support. We also have the cleanest recursive SQL implementation (i.e. without all the CTE nonsense). All you need are forward declarations!
(DBSP had recursion from day 0 -- but with this release, you can access that power via SQL as well)
(DBSP had recursion from day 0 -- but with this release, you can access that power via SQL as well)
Feldera v0.31 introduces a powerful new feature: recursive queries in SQL. Recursive queries let users tackle complex problems like hierarchical data traversal & graph algorithms with a straightforward syntax. Also included: UX/design improvements to the WebConsole.
www.feldera.com/blog/increme...
www.feldera.com/blog/increme...
Incremental Update 11 at Feldera
Recursive, incremental SQL and a new UI design! A quick overview of what's new in Feldera v0.31.
www.feldera.com
December 2, 2024 at 8:26 PM
Feldera SQL is now Turing Complete, with recursive SQL support. We also have the cleanest recursive SQL implementation (i.e. without all the CTE nonsense). All you need are forward declarations!
(DBSP had recursion from day 0 -- but with this release, you can access that power via SQL as well)
(DBSP had recursion from day 0 -- but with this release, you can access that power via SQL as well)
RIBLT is particularly brain melting; these are not like that but are a few that I've enjoyed the last while:
* A Case for Feminism in Programming Language
Design (thought provoking) dl.acm.org/doi/pdf/10.1...
* DBSP arxiv.org/pdf/2203.16684
* Keep CALM and CRDT On arxiv.org/pdf/2210.12605
* A Case for Feminism in Programming Language
Design (thought provoking) dl.acm.org/doi/pdf/10.1...
* DBSP arxiv.org/pdf/2203.16684
* Keep CALM and CRDT On arxiv.org/pdf/2210.12605
dl.acm.org
December 10, 2025 at 8:06 PM
RIBLT is particularly brain melting; these are not like that but are a few that I've enjoyed the last while:
* A Case for Feminism in Programming Language
Design (thought provoking) dl.acm.org/doi/pdf/10.1...
* DBSP arxiv.org/pdf/2203.16684
* Keep CALM and CRDT On arxiv.org/pdf/2210.12605
* A Case for Feminism in Programming Language
Design (thought provoking) dl.acm.org/doi/pdf/10.1...
* DBSP arxiv.org/pdf/2203.16684
* Keep CALM and CRDT On arxiv.org/pdf/2210.12605
Listen to @thegeeknarrator.bsky.social podcast! @feldera.bsky.social CEO, @lalithsuresh.bsky.social, discusses Feldera's approach to incremental view maintenance and the foundational breakthrough -- DBSP -- that powers it, engine internals, storage, handling late events.
youtu.be/GpcIoABwF60?...
youtu.be/GpcIoABwF60?...
Powering Incremental Compute with Mathematics - Feldera
YouTube video by The Geek Narrator
youtu.be
March 17, 2025 at 5:26 PM
Listen to @thegeeknarrator.bsky.social podcast! @feldera.bsky.social CEO, @lalithsuresh.bsky.social, discusses Feldera's approach to incremental view maintenance and the foundational breakthrough -- DBSP -- that powers it, engine internals, storage, handling late events.
youtu.be/GpcIoABwF60?...
youtu.be/GpcIoABwF60?...
No, way...
Turso, a Rust rewrite of SQLite that is approaching public beta, is actually experimenting with incremental view maintenance and query subscriptions.
I thought it was beyond hoping to get that kind of feature in SQLite, but we might be a lot closer than I thought.
@tur.so is insane! 🤩
Turso, a Rust rewrite of SQLite that is approaching public beta, is actually experimenting with incremental view maintenance and query subscriptions.
I thought it was beyond hoping to get that kind of feature in SQLite, but we might be a lot closer than I thought.
@tur.so is insane! 🤩
September 17, 2025 at 11:47 PM
No, way...
Turso, a Rust rewrite of SQLite that is approaching public beta, is actually experimenting with incremental view maintenance and query subscriptions.
I thought it was beyond hoping to get that kind of feature in SQLite, but we might be a lot closer than I thought.
@tur.so is insane! 🤩
Turso, a Rust rewrite of SQLite that is approaching public beta, is actually experimenting with incremental view maintenance and query subscriptions.
I thought it was beyond hoping to get that kind of feature in SQLite, but we might be a lot closer than I thought.
@tur.so is insane! 🤩
Will be blogging about correctness at Feldera! As PL and verification nerds, we:
* Formally verified the DBSP theory with Lean
* Use differential testing extensively: model-based, PG/DuckDB/DataFusion comparisons, fault vs fault-free
* Rely heavily on fuzzing and automated testing tools
* Formally verified the DBSP theory with Lean
* Use differential testing extensively: model-based, PG/DuckDB/DataFusion comparisons, fault vs fault-free
* Rely heavily on fuzzing and automated testing tools
November 27, 2024 at 5:32 PM
Will be blogging about correctness at Feldera! As PL and verification nerds, we:
* Formally verified the DBSP theory with Lean
* Use differential testing extensively: model-based, PG/DuckDB/DataFusion comparisons, fault vs fault-free
* Rely heavily on fuzzing and automated testing tools
* Formally verified the DBSP theory with Lean
* Use differential testing extensively: model-based, PG/DuckDB/DataFusion comparisons, fault vs fault-free
* Rely heavily on fuzzing and automated testing tools
my collaborator Bruno has an awesome little implementation of DBSP in Python here github.com/brurucy/pydbsp
GitHub - brurucy/pydbsp: This library provides an implementation of the DBSP language for incremental streaming computations.
This library provides an implementation of the DBSP language for incremental streaming computations. - brurucy/pydbsp
github.com
November 27, 2024 at 2:16 AM
my collaborator Bruno has an awesome little implementation of DBSP in Python here github.com/brurucy/pydbsp
In my POV, there was a decades long barrier to doing IVM well that the DBSP paper crossed (which is the foundation behind Feldera's IVM engine). You can learn more here: github.com/feldera/feld...
GitHub - feldera/feldera: The Feldera Incremental Computation Engine
The Feldera Incremental Computation Engine. Contribute to feldera/feldera development by creating an account on GitHub.
github.com
November 20, 2024 at 4:50 AM
In my POV, there was a decades long barrier to doing IVM well that the DBSP paper crossed (which is the foundation behind Feldera's IVM engine). You can learn more here: github.com/feldera/feld...
I wonder if compilers could use DBSP, an algorithm for live-updating SQL db views, to run incremental compilation in the background lobste.rs/s/5s4em5
July 10, 2026 at 6:11 PM
I wonder if compilers could use DBSP, an algorithm for live-updating SQL db views, to run incremental compilation in the background lobste.rs/s/5s4em5