Thanks to jetlag I had some time this morning to play around #modelJars and I have to say it’s pretty slick if you need local #llm inference on the JVM.
October 29, 2026 at 12:06 PM
Thanks to jetlag I had some time this morning to play around #modelJars and I have to say it’s pretty slick if you need local #llm inference on the JVM.
Four local models and three hosted providers, one router, rules instead of if-statements. 7 of 10 requests never left my laptop and the bill came to a third. Four of my own quality claims failed measurement — fixing them made the fleet better, not smaller.
medium.com/@bsbodden_68...
medium.com/@bsbodden_68...
ModelJars… your local JVM AI model catalog
ModelJars publishes AI models as Maven artifacts. You add a coordinate, and the model’s weights arrive through the same resolver that…
medium.com
October 28, 2026 at 8:43 PM
Four local models and three hosted providers, one router, rules instead of if-statements. 7 of 10 requests never left my laptop and the bill came to a third. Four of my own quality claims failed measurement — fixing them made the fleet better, not smaller.
medium.com/@bsbodden_68...
medium.com/@bsbodden_68...
Jev-style decisions inside the #JVM... We just started supporting decision models on modeljars.org. We crafted Harriet, an initial recipe model over a 4B model that mimics what #Jev does.
In this article medium.com/@bsbodden_68... I show the mechanics of using Harriet with plain #Java and #Spring
In this article medium.com/@bsbodden_68... I show the mechanics of using Harriet with plain #Java and #Spring
Using Jev-Style Models from ModelJars
In the vast majority of RAG and Agentic applications, a lot of what the application asks of a model is to make decisions: which queue does…
medium.com
October 30, 2026 at 6:47 PM
Jev-style decisions inside the #JVM... We just started supporting decision models on modeljars.org. We crafted Harriet, an initial recipe model over a 4B model that mimics what #Jev does.
In this article medium.com/@bsbodden_68... I show the mechanics of using Harriet with plain #Java and #Spring
In this article medium.com/@bsbodden_68... I show the mechanics of using Harriet with plain #Java and #Spring
How local can a local LLM get? With ModelJars and Models, you can skip the model server entirely and run inference inside the same JVM as your Spring AI application.
See how in this Spring AI Recipe!
medium.com/@thetalkinga...
#SpringAI #Java #LocalLLM #GenerativeAI #ModelJars
See how in this Spring AI Recipe!
medium.com/@thetalkinga...
#SpringAI #Java #LocalLLM #GenerativeAI #ModelJars
September 7, 2026 at 4:02 PM
How local can a local LLM get? With ModelJars and Models, you can skip the model server entirely and run inference inside the same JVM as your Spring AI application.
See how in this Spring AI Recipe!
medium.com/@thetalkinga...
#SpringAI #Java #LocalLLM #GenerativeAI #ModelJars
See how in this Spring AI Recipe!
medium.com/@thetalkinga...
#SpringAI #Java #LocalLLM #GenerativeAI #ModelJars