https://www.tornadovm.org/
✅ Compatible with any JDK 21-27 distribution.
✅ Cold start down 37%.
✅ 4.1× faster GEMM with Tensor-Core MMA.
✅ ~7,400 lines of C/C++ glue deleted.
📖 New blog: www.tornadovm.org/blogs/tornad...
#Java #GPU #CUDA #TornadoVM #OpenSource #HPC #AI
📌No more separate jdk25 branch, no back-syncing every PR from develop - one build for JDK 21–27.
📌Native code also migrated from JNI to Panama's FFM API - 7.5k lines of C++ gone.
Kudos to all contributors! 👏
#opensource #Java #GPU #AI
✅ Compatible with any JDK 21-27 distribution.
✅ Cold start down 37%.
✅ 4.1× faster GEMM with Tensor-Core MMA.
✅ ~7,400 lines of C/C++ glue deleted.
📖 New blog: www.tornadovm.org/blogs/tornad...
#Java #GPU #CUDA #TornadoVM #OpenSource #HPC #AI
📌No more separate jdk25 branch, no back-syncing every PR from develop - one build for JDK 21–27.
📌Native code also migrated from JNI to Panama's FFM API - 7.5k lines of C++ gone.
Kudos to all contributors! 👏
#opensource #Java #GPU #AI
✅ Compatible with any JDK 21-27 distribution.
✅ Cold start down 37%.
✅ 4.1× faster GEMM with Tensor-Core MMA.
✅ ~7,400 lines of C/C++ glue deleted.
📖 New blog: www.tornadovm.org/blogs/tornad...
#Java #GPU #CUDA #TornadoVM #OpenSource #HPC #AI
✅ Compatible with any JDK 21-27 distribution.
✅ Cold start down 37%.
✅ 4.1× faster GEMM with Tensor-Core MMA.
✅ ~7,400 lines of C/C++ glue deleted.
📖 New blog: www.tornadovm.org/blogs/tornad...
#Java #GPU #CUDA #TornadoVM #OpenSource #HPC #AI
✅ Compatible with any JDK 21-27 distribution.
✅ Cold start down 37%.
✅ 4.1× faster GEMM with Tensor-Core MMA.
✅ ~7,400 lines of C/C++ glue deleted.
📖 New blog: www.tornadovm.org/blogs/tornad...
#Java #GPU #CUDA #TornadoVM #OpenSource #HPC #AI
🛠️ Tools in Action: NVIDIA ecosystem from Java via #TornadoVM's Hybrid API
🎤 Talk: Building LLM inference engines in Java with TornadoVM
🧑💻 Hands-on Lab: From install to insight — a GPU lab for Java devs
Stay tuned
#Java #CUDA #LLM #AI #GPU #opensource
🛠️ Tools in Action: NVIDIA ecosystem from Java via #TornadoVM's Hybrid API
🎤 Talk: Building LLM inference engines in Java with TornadoVM
🧑💻 Hands-on Lab: From install to insight — a GPU lab for Java devs
Stay tuned
#Java #CUDA #LLM #AI #GPU #opensource
🛠️ Tools in Action: NVIDIA ecosystem from Java via #TornadoVM's Hybrid API
🎤 Talk: Building LLM inference engines in Java with TornadoVM
🧑💻 Hands-on Lab: From install to insight — a GPU lab for Java devs
Stay tuned
#Java #CUDA #LLM #AI #GPU #opensource
✅ TornadoVM CUDA backend w/ tensor-core (MMA) batch prefill
✅ FP16 & Q8_0 · Llama, Qwen, Devstral & more models
✅ An OpenAI-compatible server (llama-tornado --server)
Pure #Java. No JNI.
github.com/beehive-lab/GPULlama3.java
#opensource #AI #LLM #GPU
#opensource #AI #Java #GPU
✅ TornadoVM CUDA backend w/ tensor-core (MMA) batch prefill
✅ FP16 & Q8_0 · Llama, Qwen, Devstral & more models
✅ An OpenAI-compatible server (llama-tornado --server)
Pure #Java. No JNI.
github.com/beehive-lab/GPULlama3.java
#opensource #AI #LLM #GPU
#opensource #AI #Java #GPU
✅ TornadoVM CUDA backend w/ tensor-core (MMA) batch prefill
✅ FP16 & Q8_0 · Llama, Qwen, Devstral & more models
✅ An OpenAI-compatible server (llama-tornado --server)
Pure #Java. No JNI.
github.com/beehive-lab/GPULlama3.java
#opensource #AI #LLM #GPU
✅ TornadoVM CUDA backend w/ tensor-core (MMA) batch prefill
✅ FP16 & Q8_0 · Llama, Qwen, Devstral & more models
✅ An OpenAI-compatible server (llama-tornado --server)
Pure #Java. No JNI.
github.com/beehive-lab/GPULlama3.java
#opensource #AI #LLM #GPU
📄 Get the brochure: aero-project.eu/posts/aero-v...
#OpenSource #cloud
@hipeac.bsky.social
@euprojectpulse.bsky.social
📄 Get the brochure: aero-project.eu/posts/aero-v...
#OpenSource #cloud
@hipeac.bsky.social
@euprojectpulse.bsky.social
www.linkedin.com/pulse/java-g...
#Java #GPU #TornadoVM #opensource
www.linkedin.com/pulse/java-g...
#Java #GPU #TornadoVM #opensource
🔗 #InfoQ News Roundup: bit.ly/4pq19Bl
🔗 #InfoQ News Roundup: bit.ly/4pq19Bl
Becoming #CUDA native unlocks new potentials for high performance #Java #AI inference with zero dependencies.
Checkout our latest release, blogs, and new website 👇
TornadoVM's Hybrid API drops a native cuBLAS call straight into a TaskGraph - same buffers, same #CUDA stream, zero host round-trips.
⚡ Run with the Hybrid API: bit.ly/4vqL7sq
📖 Full engineering deep dive: bit.ly/44VecBf
#AI #GPU
TornadoVM's Hybrid API drops a native cuBLAS call straight into a TaskGraph - same buffers, same #CUDA stream, zero host round-trips.
⚡ Run with the Hybrid API: bit.ly/4vqL7sq
📖 Full engineering deep dive: bit.ly/44VecBf
#AI #GPU
TornadoVM's Hybrid API drops a native cuBLAS call straight into a TaskGraph - same buffers, same #CUDA stream, zero host round-trips.
⚡ Run with the Hybrid API: bit.ly/4vqL7sq
📖 Full engineering deep dive: bit.ly/44VecBf
#AI #GPU
GPU-accelerated, local LLM inference in pure Java, from a #Quarkus #LangChain4j app. No Python. No CUDA. #TornadoVM
🔗 youtu.be/9YCRUwr7pO8
#horizoneurope
@hipeac.bsky.social
@eucloudedgeiot.bsky.social
@quarkus.io
@langchain4j.dev
GPU-accelerated, local LLM inference in pure Java, from a #Quarkus #LangChain4j app. No Python. No CUDA. #TornadoVM
🔗 youtu.be/9YCRUwr7pO8
#horizoneurope
@hipeac.bsky.social
@eucloudedgeiot.bsky.social
@quarkus.io
@langchain4j.dev
Run GPU-accelerated, local LLM inference in Java - from a @quarkus.io @langchain4j.dev app. No Python. No CUDA. Just Java. All inside the JVM - powered by #TornadoVM + GPULlama3.
🔗 youtu.be/9YCRUwr7pO8?...
#Java #GPU #LLM #AI #opensource
Run GPU-accelerated, local LLM inference in Java - from a @quarkus.io @langchain4j.dev app. No Python. No CUDA. Just Java. All inside the JVM - powered by #TornadoVM + GPULlama3.
🔗 youtu.be/9YCRUwr7pO8?...
#Java #GPU #LLM #AI #opensource
Run GPU-accelerated LLMs in pure Java from a @quarkus.io #Langchain4j apps. No Python. No CUDA. Just #Java with @tornadovm.org.
A collab between @manchester.ac.uk & Red Hat!
🔗 aero-project.eu/posts/runnin...
#Java #LLM #AI #LLM #GPU #opensource
Run GPU-accelerated LLMs in pure Java from a @quarkus.io #Langchain4j apps. No Python. No CUDA. Just #Java with @tornadovm.org.
A collab between @manchester.ac.uk & Red Hat!
🔗 aero-project.eu/posts/runnin...
#Java #LLM #AI #LLM #GPU #opensource
I presented our latest work on @tornadovm.org and #GPULlama3 for seamless #GPU acceleration of local #AI inference with @quarkus.io and @langchain4j.dev.
Thanks to organizers, speakers, attendees & photographers for a great event.
#opensource
I presented our latest work on @tornadovm.org and #GPULlama3 for seamless #GPU acceleration of local #AI inference with @quarkus.io and @langchain4j.dev.
Thanks to organizers, speakers, attendees & photographers for a great event.
#opensource
Looking forward to sharing our work on #GPULlama3, @tornadovm.org and their integration with @quarkus.io @langchain4j.dev.
Join me on Thursday (4/6) at 14:05, in Hall A:
jprime.io/agenda/275
#jPrime26 #Java #GPUs #AI #TornadoVM
Looking forward to sharing our work on #GPULlama3, @tornadovm.org and their integration with @quarkus.io @langchain4j.dev.
Join me on Thursday (4/6) at 14:05, in Hall A:
jprime.io/agenda/275
#jPrime26 #Java #GPUs #AI #TornadoVM
“Pulse: A Profiling & Visualization Infrastructure for Heterogeneous Managed Systems”
📅 Thu, May 7
🕒 14:40–15:00
🔗 github.com/beehive-lab/...
📄 zenodo.org/records/1895...
#opensource #Java #GPU #TornadoVM
“Pulse: A Profiling & Visualization Infrastructure for Heterogeneous Managed Systems”
📅 Thu, May 7
🕒 14:40–15:00
🔗 github.com/beehive-lab/...
📄 zenodo.org/records/1895...
#opensource #Java #GPU #TornadoVM
Great discussions, insightful sessions, and a fantastic community pushing the boundaries of high-performance #Java and #GPUs.
📸 Photo credit: @ddoutsiopoulos.bsky.social
Great discussions, insightful sessions, and a fantastic community pushing the boundaries of high-performance #Java and #GPUs.
📸 Photo credit: @ddoutsiopoulos.bsky.social
As part of the AERO project, we’re excited to support open-source innovation that pushes the boundaries of running local LLMs on GPUs directly from #Java.
@euprojectpulse.bsky.social
@hipeac.bsky.social
@eucloudedgeiot.bsky.social
#opensource
From open-source evolution to running LLMs on GPUs directly from Java - there’s a lot to explore.
Stay tuned for more!
#opensource #Java #TornadoVM #AI #LLM #GPUs
As part of the AERO project, we’re excited to support open-source innovation that pushes the boundaries of running local LLMs on GPUs directly from #Java.
@euprojectpulse.bsky.social
@hipeac.bsky.social
@eucloudedgeiot.bsky.social
#opensource
From open-source evolution to running LLMs on GPUs directly from Java - there’s a lot to explore.
Stay tuned for more!
#opensource #Java #TornadoVM #AI #LLM #GPUs
From open-source evolution to running LLMs on GPUs directly from Java - there’s a lot to explore.
Stay tuned for more!
#opensource #Java #TornadoVM #AI #LLM #GPUs