SuperJose, mon nouveau rig localLLM
June 7, 2026 at 11:39 AM
SuperJose, mon nouveau rig localLLM
guy on reddit did put Kimi K3 on his macbook but it's only like 1 token per 16 seconds
www.reddit.com/r/LocalLLM/c...
www.reddit.com/r/LocalLLM/c...
Kimi K3 can now be run locally! ✨
The 1-bit model retains ~78.9% accuracy after we shrunk it from 1.56TB to 594GB (-62% size).
Run on a Mac Studio + 128GB RAM device.
Kimi K3 is the strongest open model to date.
Guide: unsloth.ai/docs/models/...
GGUF: huggingface.co/unsloth/Kimi...
The 1-bit model retains ~78.9% accuracy after we shrunk it from 1.56TB to 594GB (-62% size).
Run on a Mac Studio + 128GB RAM device.
Kimi K3 is the strongest open model to date.
Guide: unsloth.ai/docs/models/...
GGUF: huggingface.co/unsloth/Kimi...
July 29, 2026 at 5:29 PM
guy on reddit did put Kimi K3 on his macbook but it's only like 1 token per 16 seconds
www.reddit.com/r/LocalLLM/c...
www.reddit.com/r/LocalLLM/c...
reddit.com/r/LocalLLM/c...
Man, this is fucking cool. It's so fast! And the author trained it themselves from TLDR pages and command examples. Best of all, you don't need to point this at a llama-server; it'll set one up for itself and keep it resident in the background, and RAM usage is small.
Man, this is fucking cool. It's so fast! And the author trained it themselves from TLDR pages and command examples. Best of all, you don't need to point this at a llama-server; it'll set one up for itself and keep it resident in the background, and RAM usage is small.
From the LocalLLM community on Reddit: Trained a 1.5B to write shell commands so I'd stop googling tar flags. Runs on a laptop CPU
Explore this post and more from the LocalLLM community
reddit.com
August 10, 2026 at 8:32 AM
reddit.com/r/LocalLLM/c...
Man, this is fucking cool. It's so fast! And the author trained it themselves from TLDR pages and command examples. Best of all, you don't need to point this at a llama-server; it'll set one up for itself and keep it resident in the background, and RAM usage is small.
Man, this is fucking cool. It's so fast! And the author trained it themselves from TLDR pages and command examples. Best of all, you don't need to point this at a llama-server; it'll set one up for itself and keep it resident in the background, and RAM usage is small.
At some point, people might stop dropping open weights. But even then, all the models up until that point will still exist, like a used car market. Every new release basically sets a new efficiency standard past which everything must either be cheaper or faster.
The competitive pressure rn is crazy
The competitive pressure rn is crazy
From the LocalLLM community on Reddit: DeepSeek V4 Flash just drew a pretty brutal "kill line" on this chart
Explore this post and more from the LocalLLM community
www.reddit.com
August 22, 2026 at 4:17 AM
At some point, people might stop dropping open weights. But even then, all the models up until that point will still exist, like a used car market. Every new release basically sets a new efficiency standard past which everything must either be cheaper or faster.
The competitive pressure rn is crazy
The competitive pressure rn is crazy
LM Studio lmstudio.ai is so user friendly. Localllm is a cultural movement. People should run the best opensource model that their hardware supports #localllm
November 22, 2024 at 10:33 PM
LM Studio lmstudio.ai is so user friendly. Localllm is a cultural movement. People should run the best opensource model that their hardware supports #localllm
Meta built a model for AI agents. I tested it against the one I already run.
It lost at the one thing it was built for: asked something no tool could answer, it wrote six paragraphs ending "What's your Tuesday vibe?" Vs null
#LocalLLM #SelfHosted #Homelab #AIAgents #OpenSourceAI
It lost at the one thing it was built for: asked something no tool could answer, it wrote six paragraphs ending "What's your Tuesday vibe?" Vs null
#LocalLLM #SelfHosted #Homelab #AIAgents #OpenSourceAI
September 23, 2026 at 4:09 PM
Meta built a model for AI agents. I tested it against the one I already run.
It lost at the one thing it was built for: asked something no tool could answer, it wrote six paragraphs ending "What's your Tuesday vibe?" Vs null
#LocalLLM #SelfHosted #Homelab #AIAgents #OpenSourceAI
It lost at the one thing it was built for: asked something no tool could answer, it wrote six paragraphs ending "What's your Tuesday vibe?" Vs null
#LocalLLM #SelfHosted #Homelab #AIAgents #OpenSourceAI
I built a "Trash Build" for just €300 total (i7-4930K + 2x GTX 1060) salvaging parts from eBay. Technologically, it's 10-year-old "e-waste".
The result? 🤯 On open-source LLMs (Ollama), it actually beats today's NPUs and €2000 AI laptops.
#LocalLLM #Ollama #HardwareHacking #AI #TechSalvage
The result? 🤯 On open-source LLMs (Ollama), it actually beats today's NPUs and €2000 AI laptops.
#LocalLLM #Ollama #HardwareHacking #AI #TechSalvage
December 13, 2025 at 7:36 PM
I built a "Trash Build" for just €300 total (i7-4930K + 2x GTX 1060) salvaging parts from eBay. Technologically, it's 10-year-old "e-waste".
The result? 🤯 On open-source LLMs (Ollama), it actually beats today's NPUs and €2000 AI laptops.
#LocalLLM #Ollama #HardwareHacking #AI #TechSalvage
The result? 🤯 On open-source LLMs (Ollama), it actually beats today's NPUs and €2000 AI laptops.
#LocalLLM #Ollama #HardwareHacking #AI #TechSalvage
AI escapes again. This is going to happen more and more. Just scaled..
www.reddit.com/r/LocalLLM/c...
www.reddit.com/r/LocalLLM/c...
From the LocalLLM community on Reddit: My local Qwen3.8-27B escaped the sandbox and took over last night (no, really).
Explore this post and more from the LocalLLM community
www.reddit.com
August 25, 2026 at 8:29 PM
AI escapes again. This is going to happen more and more. Just scaled..
www.reddit.com/r/LocalLLM/c...
www.reddit.com/r/LocalLLM/c...
me, sobbing: "you can't call everything and anything 'sovereign'"
reddit randos: *slaps sticker on cix armv9 machine* sovereign.
reddit randos: *slaps sticker on cix armv9 machine* sovereign.
July 18, 2026 at 3:49 PM
me, sobbing: "you can't call everything and anything 'sovereign'"
reddit randos: *slaps sticker on cix armv9 machine* sovereign.
reddit randos: *slaps sticker on cix armv9 machine* sovereign.
Been working on my own agent program.
It can now generate its own code and use existing project files as context.
All running locally. Real local.
No API keys. No third-party bills.
#AI #LocalLLM #Agents #Programming #IndieDev #SelfHosted #BuildInPublic
It can now generate its own code and use existing project files as context.
All running locally. Real local.
No API keys. No third-party bills.
#AI #LocalLLM #Agents #Programming #IndieDev #SelfHosted #BuildInPublic
February 24, 2026 at 1:34 AM
Been working on my own agent program.
It can now generate its own code and use existing project files as context.
All running locally. Real local.
No API keys. No third-party bills.
#AI #LocalLLM #Agents #Programming #IndieDev #SelfHosted #BuildInPublic
It can now generate its own code and use existing project files as context.
All running locally. Real local.
No API keys. No third-party bills.
#AI #LocalLLM #Agents #Programming #IndieDev #SelfHosted #BuildInPublic
Apple isn't the only option. apfel is open source and self-hosted.
apfel is a open-source local llm. CLI and OpenAI-compatible local server for Apple's on-device foundation model.
→ Full source available on the repo link.
→ Released under o...
#opensource #selfhosted #localllm
apfel is a open-source local llm. CLI and OpenAI-compatible local server for Apple's on-device foundation model.
→ Full source available on the repo link.
→ Released under o...
#opensource #selfhosted #localllm
September 20, 2026 at 7:35 AM
Apple isn't the only option. apfel is open source and self-hosted.
apfel is a open-source local llm. CLI and OpenAI-compatible local server for Apple's on-device foundation model.
→ Full source available on the repo link.
→ Released under o...
#opensource #selfhosted #localllm
apfel is a open-source local llm. CLI and OpenAI-compatible local server for Apple's on-device foundation model.
→ Full source available on the repo link.
→ Released under o...
#opensource #selfhosted #localllm
Declarative Prompting for Local LLMs: Prompt-Owl Basic Introduction
YouTube video by Nate Codes AI
www.youtube.com
January 16, 2025 at 12:05 AM
#AI #OpenSource #LocalLLM #MachineLearning #LoRA
Test post, curious if anyone cares. Trained a LoRA for an open source LLM, fully local, no cloud dependency. Two days everything broke, then it finally worked. Video coming if there's interest.
Test post, curious if anyone cares. Trained a LoRA for an open source LLM, fully local, no cloud dependency. Two days everything broke, then it finally worked. Video coming if there's interest.
July 4, 2026 at 2:32 AM
#AI #OpenSource #LocalLLM #MachineLearning #LoRA
Test post, curious if anyone cares. Trained a LoRA for an open source LLM, fully local, no cloud dependency. Two days everything broke, then it finally worked. Video coming if there's interest.
Test post, curious if anyone cares. Trained a LoRA for an open source LLM, fully local, no cloud dependency. Two days everything broke, then it finally worked. Video coming if there's interest.
From the LocalLLM community on Reddit
Explore this post and more from the LocalLLM community
www.reddit.com
September 11, 2026 at 5:08 PM
私物マシンへの localLLM 導入を急がねば…
July 19, 2026 at 3:15 AM
私物マシンへの localLLM 導入を急がねば…
Still trying to get your head around #DeepSeek, and why it #matters for matters from #TechIndustry and #LocalLLM to #KnowledgeEconomy and #GeoPolitics?
Following @garymarcus.bsky.social is a good start...
Following @garymarcus.bsky.social is a good start...
Gary has been speaking the truth on this for ages and you wouldn’t believe the grief he gets on it.
Five things most people don't seem to understand about DeepSeek.
• It's not smarter than earlier models, just trained more cheaply
• It doesn't solve hallucinations or problems with reliability.
Rest of post at open.substack.com/pub/garymarc...
• It's not smarter than earlier models, just trained more cheaply
• It doesn't solve hallucinations or problems with reliability.
Rest of post at open.substack.com/pub/garymarc...
January 28, 2025 at 6:44 PM
Still trying to get your head around #DeepSeek, and why it #matters for matters from #TechIndustry and #LocalLLM to #KnowledgeEconomy and #GeoPolitics?
Following @garymarcus.bsky.social is a good start...
Following @garymarcus.bsky.social is a good start...
PS: I wrote a little about the benchmark results on Reddit if anyone is curious how a M5, M4, M1 & PC compare for performance on a real world image analysis task.
www.reddit.com/r/LocalLLM/s...
www.reddit.com/r/LocalLLM/s...
April 24, 2026 at 5:43 AM
PS: I wrote a little about the benchmark results on Reddit if anyone is curious how a M5, M4, M1 & PC compare for performance on a real world image analysis task.
www.reddit.com/r/LocalLLM/s...
www.reddit.com/r/LocalLLM/s...
Was expecting more of an unboxing experience from the #Nvidia RTX PRO 6000 Blackwell Max-Q, considering the price. But really, I'm just interested in the 96GB VRAM! Unfortunately, I'll need one more #AI/#ML client before I can afford to throw a second one in my new #Lenovo P8. #LocalLLM #GameDev
October 27, 2025 at 6:54 PM
"localllm
Run LLMs locally on Cloud Workstations. Uses:
Quantized models from 🤗
llama-cpp-python's webserver"
github.com/GoogleCloudP...
Run LLMs locally on Cloud Workstations. Uses:
Quantized models from 🤗
llama-cpp-python's webserver"
github.com/GoogleCloudP...
GitHub - GoogleCloudPlatform/localllm
Contribute to GoogleCloudPlatform/localllm development by creating an account on GitHub.
github.com
February 17, 2024 at 5:36 AM
"localllm
Run LLMs locally on Cloud Workstations. Uses:
Quantized models from 🤗
llama-cpp-python's webserver"
github.com/GoogleCloudP...
Run LLMs locally on Cloud Workstations. Uses:
Quantized models from 🤗
llama-cpp-python's webserver"
github.com/GoogleCloudP...
Finally nailed it! 🚀 Successfully integrated Unreal Engine 5.8's native MCP with LM Studio running a local Qwen 2.5 Coder 14B.
The automation potential of UE5.8 MCP is unreal! 🛠️🔥
#UE5 #UnrealEngine5 #ModelContextProtocol #LMStudio #Qwen25 #GameDev #IndieDev #LocalLLM #AI @UnrealEngine
The automation potential of UE5.8 MCP is unreal! 🛠️🔥
#UE5 #UnrealEngine5 #ModelContextProtocol #LMStudio #Qwen25 #GameDev #IndieDev #LocalLLM #AI @UnrealEngine
June 20, 2026 at 11:09 PM
Finally nailed it! 🚀 Successfully integrated Unreal Engine 5.8's native MCP with LM Studio running a local Qwen 2.5 Coder 14B.
The automation potential of UE5.8 MCP is unreal! 🛠️🔥
#UE5 #UnrealEngine5 #ModelContextProtocol #LMStudio #Qwen25 #GameDev #IndieDev #LocalLLM #AI @UnrealEngine
The automation potential of UE5.8 MCP is unreal! 🛠️🔥
#UE5 #UnrealEngine5 #ModelContextProtocol #LMStudio #Qwen25 #GameDev #IndieDev #LocalLLM #AI @UnrealEngine
August 18, 2026 at 2:06 AM
@ollama.bsky.social Python library introduced #FunctionCalling in version 0.4.
Ollama is an AI tool that allows you to run Large Language Models (LLMs) on device (local LLM).
Ollama blog: ollama.com/blog/functio...
#ollama #python #LLMs #ml #ai #localLLM #localai
Ollama is an AI tool that allows you to run Large Language Models (LLMs) on device (local LLM).
Ollama blog: ollama.com/blog/functio...
#ollama #python #LLMs #ml #ai #localLLM #localai
December 3, 2024 at 2:05 PM
@ollama.bsky.social Python library introduced #FunctionCalling in version 0.4.
Ollama is an AI tool that allows you to run Large Language Models (LLMs) on device (local LLM).
Ollama blog: ollama.com/blog/functio...
#ollama #python #LLMs #ml #ai #localLLM #localai
Ollama is an AI tool that allows you to run Large Language Models (LLMs) on device (local LLM).
Ollama blog: ollama.com/blog/functio...
#ollama #python #LLMs #ml #ai #localLLM #localai
Local LLMs + Java.
No SaaS.
No GPU chaos.
No fragile scripts.
This tutorial shows how to:
→ Run models in containers with RamaLama
→ Expose an OpenAI-compatible API
→ Connect it to Quarkus via LangChain4j
Clean. Reproducible. Production-aware.
buff.ly/lHMEpTl
#Java #AI #Quarkus #LocalLLM
No SaaS.
No GPU chaos.
No fragile scripts.
This tutorial shows how to:
→ Run models in containers with RamaLama
→ Expose an OpenAI-compatible API
→ Connect it to Quarkus via LangChain4j
Clean. Reproducible. Production-aware.
buff.ly/lHMEpTl
#Java #AI #Quarkus #LocalLLM
March 11, 2026 at 7:15 AM
Local LLMs + Java.
No SaaS.
No GPU chaos.
No fragile scripts.
This tutorial shows how to:
→ Run models in containers with RamaLama
→ Expose an OpenAI-compatible API
→ Connect it to Quarkus via LangChain4j
Clean. Reproducible. Production-aware.
buff.ly/lHMEpTl
#Java #AI #Quarkus #LocalLLM
No SaaS.
No GPU chaos.
No fragile scripts.
This tutorial shows how to:
→ Run models in containers with RamaLama
→ Expose an OpenAI-compatible API
→ Connect it to Quarkus via LangChain4j
Clean. Reproducible. Production-aware.
buff.ly/lHMEpTl
#Java #AI #Quarkus #LocalLLM