Write often > lots of files > slow queries
Compaction > writer conflicts
Compact daily > stale performance + compute spikes
Iceberg is a spec, not a database.
WarpStream Tableflow is the database: Kafka in, compacted Iceberg out 👉 buff.ly/912xRRA
Write often > lots of files > slow queries
Compaction > writer conflicts
Compact daily > stale performance + compute spikes
Iceberg is a spec, not a database.
WarpStream Tableflow is the database: Kafka in, compacted Iceberg out 👉 buff.ly/912xRRA
tech_blogs_confluent | Author: Mike Agnich
#DataEngineering
tech_blogs_confluent | Author: Mike Agnich
#DataEngineering
1. User asks a data-related question
2. LLM writes SQL query & sends request via #MCP
3. #Trino queries Iceberg table that has access to #ApacheKafka through #Tableflow
youtu.be/EnxfTdwTUug
1. User asks a data-related question
2. LLM writes SQL query & sends request via #MCP
3. #Trino queries Iceberg table that has access to #ApacheKafka through #Tableflow
youtu.be/EnxfTdwTUug
Streaming, enhancing and aggregating data from my very biased BlueSky feed (#NeedsMoreCats) 🐱
#ApacheKafka → #ApacheFlink (with calls to LLM for vibes & tags) → #Tableflow → #ApacheIceberg → #Trino → #Superset
Streaming, enhancing and aggregating data from my very biased BlueSky feed (#NeedsMoreCats) 🐱
#ApacheKafka → #ApacheFlink (with calls to LLM for vibes & tags) → #Tableflow → #ApacheIceberg → #Trino → #Superset
I wonder if confluent's TableFlow launched about a year back has a similar design. www.confluent.io/blog/introdu...
I wonder if confluent's TableFlow launched about a year back has a similar design. www.confluent.io/blog/introdu...
We recently hosted a deep dive on how 𝗖𝗼𝗻𝗳𝗹𝘂𝗲𝗻𝘁 𝗧𝗮𝗯𝗹𝗲𝗳𝗹𝗼𝘄 and the 𝗗𝗲𝗹𝘁𝗮 𝗞𝗲𝗿𝗻𝗲𝗹 automate the move from Kafka to Databricks Unity Catalog—eliminating the need for fragile, manual ETL.
🎥 Catch the full replay on YouTube: youtube.com/live/Q8yxLKh...
#opensource #deltalake
We recently hosted a deep dive on how 𝗖𝗼𝗻𝗳𝗹𝘂𝗲𝗻𝘁 𝗧𝗮𝗯𝗹𝗲𝗳𝗹𝗼𝘄 and the 𝗗𝗲𝗹𝘁𝗮 𝗞𝗲𝗿𝗻𝗲𝗹 automate the move from Kafka to Databricks Unity Catalog—eliminating the need for fragile, manual ETL.
🎥 Catch the full replay on YouTube: youtube.com/live/Q8yxLKh...
#opensource #deltalake
#watsonx.data #confluent #IBMBob #Bob
#watsonx.data #confluent #IBMBob #Bob
https://www.bigdatawire.com/2025/03/18/confluent-gas-tableflow-adds-flink-native-inference-in-bengalaru/
#News #in #Brief #Apache #Flink #Apache #Iceberg […]
[Original post on bigdatawire.com]
https://www.bigdatawire.com/2025/03/18/confluent-gas-tableflow-adds-flink-native-inference-in-bengalaru/
#News #in #Brief #Apache #Flink #Apache #Iceberg […]
[Original post on bigdatawire.com]
https://www.bigdatawire.com/2025/03/18/confluent-gas-tableflow-adds-flink-native-inference-in-bengalaru/
#News #in #Brief #Apache #Flink #Apache #Iceberg […]
[Original post on bigdatawire.com]
https://www.bigdatawire.com/2025/03/18/confluent-gas-tableflow-adds-flink-native-inference-in-bengalaru/
#News #in #Brief #Apache #Flink #Apache #Iceberg […]
[Original post on bigdatawire.com]
🔷 Tableflow is now GA on Microsoft Azure! No more manual ETL, turn Apache Kafka topics into Iceberg tables with one click.
🔷 Tableflow is now GA on Microsoft Azure! No more manual ETL, turn Apache Kafka topics into Iceberg tables with one click.
Our 🆕 14-module course hosted by @tlberglund.bsky.social covers how Iceberg brings transactions, time travel, and painless schema evolution to petabyte-scale data lakes.
Get started: https://cnfl.io/4c07BdH
Our 🆕 14-module course hosted by @tlberglund.bsky.social covers how Iceberg brings transactions, time travel, and painless schema evolution to petabyte-scale data lakes.
Get started: https://cnfl.io/4c07BdH
Dive into our full CDC demo here: https://cnfl.io/4ppcOQ6
Dive into our full CDC demo here: https://cnfl.io/4ppcOQ6
Join our virtual workshop on December 10th, to learn how to manage Apache Kafka streams and Apache Flink queries directly from VS Code using our latest integrations!
Space is limited, sign up today! ⤵️
Join our virtual workshop on December 10th, to learn how to manage Apache Kafka streams and Apache Flink queries directly from VS Code using our latest integrations!
Space is limited, sign up today! ⤵️
On Dec 16th, we'll walk you through implementing an end-to-end, streaming-to-AI insight data pipeline.
Get hands-on experience with Tableflow, Oracle XStream CDC, Databricks Genie, + more 👉 https://cnfl.io/3XNJh6h
On Dec 16th, we'll walk you through implementing an end-to-end, streaming-to-AI insight data pipeline.
Get hands-on experience with Tableflow, Oracle XStream CDC, Databricks Genie, + more 👉 https://cnfl.io/3XNJh6h
From Delta Lake + Databricks Unity Catalog support to enterprise security features, you're going to love what's 🆕 in Tableflow.
Learn more: https://cnfl.io/4hvk9KG
From Delta Lake + Databricks Unity Catalog support to enterprise security features, you're going to love what's 🆕 in Tableflow.
Learn more: https://cnfl.io/4hvk9KG
From Confluent Intelligence to a line-up of Tableflow upgrades, find out how our powerful new additions to the world’s data streaming platform can help you do just that: https://cnfl.io/4qUKVk6
From Confluent Intelligence to a line-up of Tableflow upgrades, find out how our powerful new additions to the world’s data streaming platform can help you do just that: https://cnfl.io/4qUKVk6
🎉 Delta Lake + @databricks.bsky.social Unity Catalog support are now Generally Available (cnfl.io/48TmqgC)
🎊 Tableflow is coming to Microsoft Azure (EA)
🥳 Enterprise-grade Tableflow is here with upsert materialization, new security features, and more
🎉 Delta Lake + @databricks.bsky.social Unity Catalog support are now Generally Available (cnfl.io/48TmqgC)
🎊 Tableflow is coming to Microsoft Azure (EA)
🥳 Enterprise-grade Tableflow is here with upsert materialization, new security features, and more
Learn how we're streamlining file reconciliation and combining the power of WarpStream and Tableflow: cnfl.io/47CoNDI
Learn how we're streamlining file reconciliation and combining the power of WarpStream and Tableflow: cnfl.io/47CoNDI
In this demo, @rmoff.net shows us how to build streaming ETL pipelines with Confluent Cloud using Flink® SQL to transform data and Tableflow to create Iceberg tables for analysis. Check it out now ➡️ cnfl.io/3THZeZX
In this demo, @rmoff.net shows us how to build streaming ETL pipelines with Confluent Cloud using Flink® SQL to transform data and Tableflow to create Iceberg tables for analysis. Check it out now ➡️ cnfl.io/3THZeZX
@rmoff.net walks through how to explore and validate messy real-world data from #ApacheKafka in #ApacheIceberg using Tableflow. Read it now 👉 cnfl.io/4jrtjrD
@rmoff.net walks through how to explore and validate messy real-world data from #ApacheKafka in #ApacheIceberg using Tableflow. Read it now 👉 cnfl.io/4jrtjrD
This blog walks you through it-> cnfl.io/4l7QAj6
➡️ Set up your infra with Terraform
➡️ Ingest real-time data from Oracle + Kafka
➡️ Enrich streams with Flink
➡️ Auto-sync to Delta Lake with Tableflow
➡️ Launch GenAI-powered campaigns in Databricks
This blog walks you through it-> cnfl.io/4l7QAj6
➡️ Set up your infra with Terraform
➡️ Ingest real-time data from Oracle + Kafka
➡️ Enrich streams with Flink
➡️ Auto-sync to Delta Lake with Tableflow
➡️ Launch GenAI-powered campaigns in Databricks
We met up with Kasun to break down the announcement at #DataAISummit. ⤵
Want to know more?
Head to our blog: cnfl.io/4jWBBYk
We met up with Kasun to break down the announcement at #DataAISummit. ⤵
Want to know more?
Head to our blog: cnfl.io/4jWBBYk