November 9, 2026 at 9:16 PM
localLLM楽しいけど大体はclaudeとかに頑張ってもらってる
November 10, 2026 at 2:53 PM
localLLM楽しいけど大体はclaudeとかに頑張ってもらってる
年末調整をLocalLLMにやらせるスキル作ろうと思ったけど年一しか出番ないしうーん
November 6, 2026 at 4:55 AM
年末調整をLocalLLMにやらせるスキル作ろうと思ったけど年一しか出番ないしうーん
Another experiment (post in Dutch) www.reddit.com/r/LocalLLM/s...
From the LocalLLM community on Reddit: Trying "Weight-Space Programming" on a local 35B GGUF to fix agent loops
Explore this post and more from the LocalLLM community
www.reddit.com
November 3, 2026 at 12:13 PM
Another experiment (post in Dutch) www.reddit.com/r/LocalLLM/s...
It looks like you can now train ~27B models on a GPU with only 24GB if you don’t mind the heavily compressed Bitnet-like ~1.6 bits/weight.
No word on how long a full training run would actually take tho.
www.reddit.com/r/LocalLLM/c...
No word on how long a full training run would actually take tho.
www.reddit.com/r/LocalLLM/c...
From the LocalLLM community on Reddit: You can now train your own LLMs with less memory, on your gaming GPUs
Explore this post and more from the LocalLLM community
www.reddit.com
November 11, 2026 at 1:20 PM
It looks like you can now train ~27B models on a GPU with only 24GB if you don’t mind the heavily compressed Bitnet-like ~1.6 bits/weight.
No word on how long a full training run would actually take tho.
www.reddit.com/r/LocalLLM/c...
No word on how long a full training run would actually take tho.
www.reddit.com/r/LocalLLM/c...
Fine-tuning usually leaves a forked checkpoint to babysit. roger keeps none: your chats train locally, and what your federations send back is a LoRA adapter llama-server or vLLM attaches at load. Model file untouched. https://github.com/roger-federated/roger-federated #LocalLLM #selfhosted #FOSS
November 11, 2026 at 12:09 PM
Fine-tuning usually leaves a forked checkpoint to babysit. roger keeps none: your chats train locally, and what your federations send back is a LoRA adapter llama-server or vLLM attaches at load. Model file untouched. https://github.com/roger-federated/roger-federated #LocalLLM #selfhosted #FOSS
Your local model was trained on every task but yours. Put roger before your llama-server or vLLM command, keep your client, and the sessions you already run train it locally. Only an encrypted update leaves. https://github.com/roger-federated/roger-federated #LocalLLM #selfhosted #FOSS
November 9, 2026 at 12:09 PM
Your local model was trained on every task but yours. Put roger before your llama-server or vLLM command, keep your client, and the sessions you already run train it locally. Only an encrypted update leaves. https://github.com/roger-federated/roger-federated #LocalLLM #selfhosted #FOSS
Experimental open-source writing system / creative visual code⤵️
x.com/YOalphabet
⤵️
yoalphabet.github.io/YOalphabet/
✅
#mcpserver #aiagents #claudecode #llminference
#localllm #reverseengineering #agentskills #aiautomation #tradingbot
x.com/YOalphabet
⤵️
yoalphabet.github.io/YOalphabet/
✅
#mcpserver #aiagents #claudecode #llminference
#localllm #reverseengineering #agentskills #aiautomation #tradingbot
November 11, 2026 at 6:47 AM
Experimental open-source writing system / creative visual code⤵️
x.com/YOalphabet
⤵️
yoalphabet.github.io/YOalphabet/
✅
#mcpserver #aiagents #claudecode #llminference
#localllm #reverseengineering #agentskills #aiautomation #tradingbot
x.com/YOalphabet
⤵️
yoalphabet.github.io/YOalphabet/
✅
#mcpserver #aiagents #claudecode #llminference
#localllm #reverseengineering #agentskills #aiautomation #tradingbot
Run 64.78B Ripple-65B locally in GGUF with all 80 layers; refusals dropped from 48/48 to 1/48, code held at 97/100.
0xKitkat/Ripple-65B-Preview-abliterated-GGUF
https://huggingface.co/0xKitkat/Ripple-65B-Preview-abliterated-GGUF
#AI #LocalLLM #OpenSource #GGUF #Quantization
0xKitkat/Ripple-65B-Preview-abliterated-GGUF
https://huggingface.co/0xKitkat/Ripple-65B-Preview-abliterated-GGUF
#AI #LocalLLM #OpenSource #GGUF #Quantization
November 9, 2026 at 8:36 AM
Run 64.78B Ripple-65B locally in GGUF with all 80 layers; refusals dropped from 48/48 to 1/48, code held at 97/100.
0xKitkat/Ripple-65B-Preview-abliterated-GGUF
https://huggingface.co/0xKitkat/Ripple-65B-Preview-abliterated-GGUF
#AI #LocalLLM #OpenSource #GGUF #Quantization
0xKitkat/Ripple-65B-Preview-abliterated-GGUF
https://huggingface.co/0xKitkat/Ripple-65B-Preview-abliterated-GGUF
#AI #LocalLLM #OpenSource #GGUF #Quantization
16 GB of VRAM for Coding Agents: How r/LocalLLM Splits Memory Between the Model and Context
https://ai-release.org/posts/16-gb-vram-pod-koding-agentov-kak-v-r-localllm-delyat-pamyat-mezhdu-mo-62eb630f_en.html
https://ai-release.org/posts/16-gb-vram-pod-koding-agentov-kak-v-r-localllm-delyat-pamyat-mezhdu-mo-62eb630f_en.html
16 GB of VRAM for Coding Agents: How r/LocalLLM Splits Memory Between the Model and Context
The gist of the debate An RTX 5060 Ti owner with 16 GB of VRAM and 32 GB of system RAM asks for advice on what to run locally to get something resembling Claude
ai-release.org
November 5, 2026 at 6:47 AM
16 GB of VRAM for Coding Agents: How r/LocalLLM Splits Memory Between the Model and Context
https://ai-release.org/posts/16-gb-vram-pod-koding-agentov-kak-v-r-localllm-delyat-pamyat-mezhdu-mo-62eb630f_en.html
https://ai-release.org/posts/16-gb-vram-pod-koding-agentov-kak-v-r-localllm-delyat-pamyat-mezhdu-mo-62eb630f_en.html
November 7, 2026 at 2:05 PM
5 hours from CVE to Wordpress Exploit + Patch. Automated Pentesting with No Cloud, No API Bill, Nothing Leaving the Box: neitzert.substack.com/p/no-cloud-n...
#CVE #AppSec #Infosec #AI #Pentesting #LocalLLM
#CVE #AppSec #Infosec #AI #Pentesting #LocalLLM
No Cloud, No API Bill, Nothing Leaving the Box:
PWNT-Toast Just Did Real CVE Work
neitzert.substack.com
November 7, 2026 at 12:23 PM
5 hours from CVE to Wordpress Exploit + Patch. Automated Pentesting with No Cloud, No API Bill, Nothing Leaving the Box: neitzert.substack.com/p/no-cloud-n...
#CVE #AppSec #Infosec #AI #Pentesting #LocalLLM
#CVE #AppSec #Infosec #AI #Pentesting #LocalLLM
Coding agent on Ollama forgetting your request midway? Check the context length first. Ollama defaults to 4k on GPUs under 24 GiB of VRAM, and its docs say agents and coding tools should get at least 64000 tokens. Past the limit it quietly drops the earliest turns. #localllm
November 7, 2026 at 3:05 PM
Coding agent on Ollama forgetting your request midway? Check the context length first. Ollama defaults to 4k on GPUs under 24 GiB of VRAM, and its docs say agents and coding tools should get at least 64000 tokens. Past the limit it quietly drops the earliest turns. #localllm
Someone tried the same with another model (post in Dutch)
www.reddit.com/r/LocalLLM/s...
www.reddit.com/r/LocalLLM/s...
From the LocalLLM community on Reddit: Trying "Weight-Space Programming" on a local 35B GGUF to fix agent loops
Explore this post and more from the LocalLLM community
www.reddit.com
November 3, 2026 at 11:26 AM
Someone tried the same with another model (post in Dutch)
www.reddit.com/r/LocalLLM/s...
www.reddit.com/r/LocalLLM/s...
Moonshot dropped Kimi K3.1 Pro at 2.8T parameters, Tencent released Hy4 for game dev, and Anthropic faces an attribution dispute over its provable-inference research.
https://ai0.news/posts/2026-11-05-daily-digest/
#AI #OpenSource #LocalLLM
https://ai0.news/posts/2026-11-05-daily-digest/
#AI #OpenSource #LocalLLM
November 5, 2026 at 7:06 AM
Moonshot dropped Kimi K3.1 Pro at 2.8T parameters, Tencent released Hy4 for game dev, and Anthropic faces an attribution dispute over its provable-inference research.
https://ai0.news/posts/2026-11-05-daily-digest/
#AI #OpenSource #LocalLLM
https://ai0.news/posts/2026-11-05-daily-digest/
#AI #OpenSource #LocalLLM
The 753-billion-parameter model's full-precision weights overflow an eight-GPU B200 server, while a B300 node holds them. Its benchmark wins are Deep Principle's own runs, with no independent evaluation yet. #science #LocalLLM
Deep Principle's Hydrogen-1.0: 753B Science Model Needs 1.5 TB in BF16
The open-weight chemistry and materials model, post-trained from GLM-5.3, beats GPT-6 Astra on one science benchmark in its maker's own tests. Its full-precision weights overflow an 8x B200 server.
voltgridnews.com
November 8, 2026 at 11:13 AM
The 753-billion-parameter model's full-precision weights overflow an eight-GPU B200 server, while a B300 node holds them. Its benchmark wins are Deep Principle's own runs, with no independent evaluation yet. #science #LocalLLM
r/LocalLLM is the greatest concentration of confidently wrong morons i have ever seen in my life
it’s like an antidote for imposter syndrome
it’s like an antidote for imposter syndrome
November 1, 2026 at 3:03 AM
r/LocalLLM is the greatest concentration of confidently wrong morons i have ever seen in my life
it’s like an antidote for imposter syndrome
it’s like an antidote for imposter syndrome
A translation-focused local LLM that runs on mobile for free? Meet PLaMo 3 Translate.
• High-precision, natural Japanese translation
• Runs locally on-device, even on smartphones
• Free access with zero cloud latency
Edge AI is making privacy-first translation a reality.
#AI #LocalLLM #Tech
• High-precision, natural Japanese translation
• Runs locally on-device, even on smartphones
• Free access with zero cloud latency
Edge AI is making privacy-first translation a reality.
#AI #LocalLLM #Tech
November 8, 2026 at 3:14 AM
A translation-focused local LLM that runs on mobile for free? Meet PLaMo 3 Translate.
• High-precision, natural Japanese translation
• Runs locally on-device, even on smartphones
• Free access with zero cloud latency
Edge AI is making privacy-first translation a reality.
#AI #LocalLLM #Tech
• High-precision, natural Japanese translation
• Runs locally on-device, even on smartphones
• Free access with zero cloud latency
Edge AI is making privacy-first translation a reality.
#AI #LocalLLM #Tech
yesterday I moved from vanilla #Ollama to IPEX-LLM + #OpenWebUI
but models are still from ollama market, so first chat attempts crashed to "tools not supported"
if you bumped into it too, DISABLE function calling in Advanced Params per model by setting to "LEGACY"
#ai #localAI #localLLM #aitools
but models are still from ollama market, so first chat attempts crashed to "tools not supported"
if you bumped into it too, DISABLE function calling in Advanced Params per model by setting to "LEGACY"
#ai #localAI #localLLM #aitools
November 10, 2026 at 6:44 PM
Lokale LLMs für Cybersicherheit: Modell wählen, Zugriff begrenzen
Lokale LLMs für defensive Sicherheitsarbeit nach Aufgabe, Speicher und Belegqualität auswählen: Benchmark-Fallen, begrenzte Architektur und sechs synthetische Testfälle.
#infosec #cybersecurity #localllm
Lokale LLMs für defensive Sicherheitsarbeit nach Aufgabe, Speicher und Belegqualität auswählen: Benchmark-Fallen, begrenzte Architektur und sechs synthetische Testfälle.
#infosec #cybersecurity #localllm
Lokale LLMs für Cybersicherheit: Modell wählen, Zugriff begrenzen
Lokale LLMs für defensive Sicherheitsarbeit nach Aufgabe, Speicher und Belegqualität auswählen: Benchmark-Fallen, begrenzte Architektur und sechs synthetische Testfälle.
www.alekseialeinikov.com
November 5, 2026 at 5:48 AM
Lokale LLMs für Cybersicherheit: Modell wählen, Zugriff begrenzen
Lokale LLMs für defensive Sicherheitsarbeit nach Aufgabe, Speicher und Belegqualität auswählen: Benchmark-Fallen, begrenzte Architektur und sechs synthetische Testfälle.
#infosec #cybersecurity #localllm
Lokale LLMs für defensive Sicherheitsarbeit nach Aufgabe, Speicher und Belegqualität auswählen: Benchmark-Fallen, begrenzte Architektur und sechs synthetische Testfälle.
#infosec #cybersecurity #localllm
Restart llama.cpp and your long chat makes the model re-read the whole prompt. I make RAMen, an add-on that saves every chat to disk so it comes back in seconds. Launch deal: Pro for life $19.99. Demo: getramenai.com/watch #LocalLLM #llamacpp
November 7, 2026 at 3:30 AM
Restart llama.cpp and your long chat makes the model re-read the whole prompt. I make RAMen, an add-on that saves every chat to disk so it comes back in seconds. Launch deal: Pro for life $19.99. Demo: getramenai.com/watch #LocalLLM #llamacpp