TornadoVM 5.0.0 beacons a very important milestone: Native CUDA support!

JIT-compiled Java kernels and native cuBLAS/cuDNN/cuFFT calls now live in the same task graph - same GPU buffers, same CUDA stream, no round-trips between them.

#opensource #Java #TornadoVM #GPU #AI

👇

TornadoVM 6.0.0 is here - JVMCI-free and JNI-free.

✅ Compatible with any JDK 21-27 distribution.
✅ Cold start down 37%.
✅ 4.1× faster GEMM with Tensor-Core MMA.
✅ ~7,400 lines of C/C++ glue deleted.

📖 New blog: www.tornadovm.org/blogs/tornad...

#Java #GPU #CUDA #TornadoVM #OpenSource #HPC #AI

The next TornadoVM release 6.0 will remove completely the dependency to JVMCI and will be onwards compatible. Babylon/HAT are complementary and we may integrate some parts when they are stable. Also we will soon land a PR to integrate with SpringAI! Your feedback is greatly appreciated!

Great effort and what an achievement! #LLM inference implemented in #Java, automatically accelerated on #GPUs with #TornadoVM & CUDA native support!

#opensource #AI #Java #GPU

GPULlama3 v1.0.0 is out - now #CUDA-native ⚡

✅ TornadoVM CUDA backend w/ tensor-core (MMA) batch prefill
✅ FP16 & Q8_0 · Llama, Qwen, Devstral & more models
✅ An OpenAI-compatible server (llama-tornado --server)

Pure #Java. No JNI.

github.com/beehive-lab/GPULlama3.java

#opensource #AI #LLM #GPU

TornadoVM has officially transitioned into a new phase. One line of code, > 150x performance.
Becoming #CUDA native unlocks new potentials for high performance #Java #AI inference with zero dependencies.
Checkout our latest release, blogs, and new website 👇

It’s been a busy week in the #Java ecosystem ➤ The GA release of TornadoVM 5.0; point releases of JHipster, Keycloak and Google ADK; maintenance releases of GraalVM Native Build Tools and Micronaut; the OmniFish Build of Payara and introducing Vidocq, and more.

🔗 #InfoQ News Roundup: bit.ly/4pq19Bl

TornadoVM 5.0.0 is CUDA-native. One line of #Java. 74× faster.

TornadoVM's Hybrid API drops a native cuBLAS call straight into a TaskGraph - same buffers, same #CUDA stream, zero host round-trips.

⚡ Run with the Hybrid API: bit.ly/4vqL7sq
📖 Full engineering deep dive: bit.ly/44VecBf

#AI #GPU

Last week we gave two presentations at #OCX26 and @devoxxgreece.bsky.social - and the recordings are now available, scan the QR code!

From open-source evolution to running LLMs on GPUs directly from Java - there’s a lot to explore.

Stay tuned for more!

#opensource #Java #TornadoVM #AI #LLM #GPUs

TornadoVM is featured in the April 2026 issue of Java Pro Magazine - “Java in the Age of AI”!

👉 javapro.io/wp-content/u...

In this article, @mikepapadim.bsky.social shared our experiences on building #GPU accelerated #LLM inference libraries with #TornadoVM.

#Java #community #AI