There are 6+ different SparkSessions in the upcoming #ApacheSpark 4.0.0 (snapshot) due to #SparkConnect 🤯

1️⃣ api.SparkSession
2️⃣ SparkSession
3️⃣ Spark Connect-aware SparkSession

Hope to get it all right in "The Internals of Spark Connect"...soon 🫣

➡️ books.japila.pl/spark-connec...

🚀 Discover Spark Connect – a lightweight interface for Apache Spark! Perfect for remote development and flexible connections to Spark clusters. Learn more here:

🔗 tinyurl.com/49hkkbcs

#ApacheSpark #BigData #SparkConnect #DataEngineering

It was with #DeltaLake, then with #UnityCatalog and now with #SparkConnect.

When you dig deeper into extensions you can learn how the base works.

In Spark apps, Spark Connect is simply a driver plugin.

➡️ books.japila.pl/spark-connec...

I've been asked a few qqs about #SparkConnect lately that I haven't really been able to answer so...I created another online book about The Internals of Spark Connect! 😆

➡️ books.japila.pl/spark-connec...

From external PoV, Spark Connect looks like #UnityCatalog = lots of gRPC.

Enjoy! ❤️

Kubeflow SDK v0.4.0: Model Registry, SparkConnect, and Enhanced Developer Experience

AIMindUpdate News!
Cut costs & speed up analytics! Snowflake's Snowpark Connect lets you run Apache Spark directly in the cloud. #Snowflake #SparkConnect #CloudAnalytics

Click here↓↓↓
aimindupdate.com/2025/07/31/s...

Day 1 at #DataAISummit. We got #SparkConnect which acts as a thin layer to bring the power of Spark to the application. Imagine a use-case mobile device or a raspberry pi with limited capacity, where you can leverage #Python, #Pandas, and #Spark within your app; crazy, right?

#ApacheSpark 3.5.4 hit the shelves 🥳

➡️ spark.apache.org/downloads.html

I'm on the main / 4.0.0-SNAPSHOT branch while exploring #SparkConnect anyway. You?

➡️ books.japila.pl/spark-connec...