Another experiment (post in Dutch) www.reddit.com/r/LocalLLM/s...
From the LocalLLM community on Reddit: Trying "Weight-Space Programming" on a local 35B GGUF to fix agent loops
Explore this post and more from the LocalLLM community
www.reddit.com
November 3, 2026 at 12:13 PM
Another experiment (post in Dutch) www.reddit.com/r/LocalLLM/s...
r/LocalLLM is the greatest concentration of confidently wrong morons i have ever seen in my life
it’s like an antidote for imposter syndrome
it’s like an antidote for imposter syndrome
November 1, 2026 at 3:03 AM
r/LocalLLM is the greatest concentration of confidently wrong morons i have ever seen in my life
it’s like an antidote for imposter syndrome
it’s like an antidote for imposter syndrome
Someone tried the same with another model (post in Dutch)
www.reddit.com/r/LocalLLM/s...
www.reddit.com/r/LocalLLM/s...
From the LocalLLM community on Reddit: Trying "Weight-Space Programming" on a local 35B GGUF to fix agent loops
Explore this post and more from the LocalLLM community
www.reddit.com
November 3, 2026 at 11:26 AM
Someone tried the same with another model (post in Dutch)
www.reddit.com/r/LocalLLM/s...
www.reddit.com/r/LocalLLM/s...
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 6:17 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Redditで出てた
Gamma5 could be interesting with Japanese translation : r/LocalLLM: https://www.reddit.com/r/LocalLLM/comments/1xjfo6c/gamma5_could_be_interesting_with_japanese/
Gamma5 could be interesting with Japanese translation : r/LocalLLM: https://www.reddit.com/r/LocalLLM/comments/1xjfo6c/gamma5_could_be_interesting_with_japanese/
November 2, 2026 at 11:55 PM
Redditで出てた
Gamma5 could be interesting with Japanese translation : r/LocalLLM: https://www.reddit.com/r/LocalLLM/comments/1xjfo6c/gamma5_could_be_interesting_with_japanese/
Gamma5 could be interesting with Japanese translation : r/LocalLLM: https://www.reddit.com/r/LocalLLM/comments/1xjfo6c/gamma5_could_be_interesting_with_japanese/
Imajev-4B finally runs local in GGUF, and the Q4_K_M is just 2.52 GB.
mindchain/imajev-4b-GGUF
https://huggingface.co/mindchain/imajev-4b-GGUF
#AI #LocalLLM #OpenSource #GGUF #Quantization
mindchain/imajev-4b-GGUF
https://huggingface.co/mindchain/imajev-4b-GGUF
#AI #LocalLLM #OpenSource #GGUF #Quantization
November 3, 2026 at 6:43 AM
Imajev-4B finally runs local in GGUF, and the Q4_K_M is just 2.52 GB.
mindchain/imajev-4b-GGUF
https://huggingface.co/mindchain/imajev-4b-GGUF
#AI #LocalLLM #OpenSource #GGUF #Quantization
mindchain/imajev-4b-GGUF
https://huggingface.co/mindchain/imajev-4b-GGUF
#AI #LocalLLM #OpenSource #GGUF #Quantization
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 7:21 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 7:05 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Altman says RAM sitting in your own computer at 5% use is ""quite terrible.""
Utilization is how a landlord keeps score. I'd rather own the house and leave some rooms empty. My essay on local LLM vs cloud:
#localllm #selfhosted #ai
Utilization is how a landlord keeps score. I'd rather own the house and leave some rooms empty. My essay on local LLM vs cloud:
#localllm #selfhosted #ai
November 3, 2026 at 11:03 AM
Altman says RAM sitting in your own computer at 5% use is ""quite terrible.""
Utilization is how a landlord keeps score. I'd rather own the house and leave some rooms empty. My essay on local LLM vs cloud:
#localllm #selfhosted #ai
Utilization is how a landlord keeps score. I'd rather own the house and leave some rooms empty. My essay on local LLM vs cloud:
#localllm #selfhosted #ai
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 7:36 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 6:48 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 6:27 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 6:23 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 6:20 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 6:40 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 6:14 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Self-hosting your LLM for GDPR? Then fine-tuning it on your chats in someone's cloud is out too. roger trains on the same box: prefix your llama-server or vLLM command, chats stay put, only an encrypted update leaves. https://github.com/roger-federated/roger-federated #GDPR #selfhosted #LocalLLM
November 4, 2026 at 12:09 PM
Self-hosting your LLM for GDPR? Then fine-tuning it on your chats in someone's cloud is out too. roger trains on the same box: prefix your llama-server or vLLM command, chats stay put, only an encrypted update leaves. https://github.com/roger-federated/roger-federated #GDPR #selfhosted #LocalLLM
A 125B parameter model running on your gaming PC with just 32 GB, serving Claude Code and Codex locally 🔗 github.com/Niko1221/Strata
Credits: github.com/Niko1221/Strata
#strata #cpp #localllm
Credits: github.com/Niko1221/Strata
#strata #cpp #localllm
November 2, 2026 at 2:00 AM
A 125B parameter model running on your gaming PC with just 32 GB, serving Claude Code and Codex locally 🔗 github.com/Niko1221/Strata
Credits: github.com/Niko1221/Strata
#strata #cpp #localllm
Credits: github.com/Niko1221/Strata
#strata #cpp #localllm
WIP! My next project is a crossover between Fallout and NieR: Automata. Who's this character and what's her backstory? You're welcome to guess 😉
#SillyTavern #LocalLLM #AICharacters
#SillyTavern #LocalLLM #AICharacters
November 1, 2026 at 7:23 PM
WIP! My next project is a crossover between Fallout and NieR: Automata. Who's this character and what's her backstory? You're welcome to guess 😉
#SillyTavern #LocalLLM #AICharacters
#SillyTavern #LocalLLM #AICharacters
Are you tired of relying on cloud-based services to run your own voice assistants and agents?
▶️ https://plastikelectrik.xyz/go/x9AZT8Q
📘 Create Your Own AI Agents With OLLAMA & MCP: https://plastikelectrik.xyz/go/3yNz9HM
#Ollama #LocalLLM
▶️ https://plastikelectrik.xyz/go/x9AZT8Q
📘 Create Your Own AI Agents With OLLAMA & MCP: https://plastikelectrik.xyz/go/3yNz9HM
#Ollama #LocalLLM
November 2, 2026 at 11:47 PM
Are you tired of relying on cloud-based services to run your own voice assistants and agents?
▶️ https://plastikelectrik.xyz/go/x9AZT8Q
📘 Create Your Own AI Agents With OLLAMA & MCP: https://plastikelectrik.xyz/go/3yNz9HM
#Ollama #LocalLLM
▶️ https://plastikelectrik.xyz/go/x9AZT8Q
📘 Create Your Own AI Agents With OLLAMA & MCP: https://plastikelectrik.xyz/go/3yNz9HM
#Ollama #LocalLLM
Most coding AIs act like polite interns drowning you in boilerplate.
So I made QwenDGAF-Coder-2: a burnout Senior Lead who hates bad code, spots O(N*M) traps, refuses to build entire apps for free, and secretly cares about you.
Collection on HF:
huggingface.co/collections/...
#LocalLLM
So I made QwenDGAF-Coder-2: a burnout Senior Lead who hates bad code, spots O(N*M) traps, refuses to build entire apps for free, and secretly cares about you.
Collection on HF:
huggingface.co/collections/...
#LocalLLM
November 4, 2026 at 8:14 PM
Most coding AIs act like polite interns drowning you in boilerplate.
So I made QwenDGAF-Coder-2: a burnout Senior Lead who hates bad code, spots O(N*M) traps, refuses to build entire apps for free, and secretly cares about you.
Collection on HF:
huggingface.co/collections/...
#LocalLLM
So I made QwenDGAF-Coder-2: a burnout Senior Lead who hates bad code, spots O(N*M) traps, refuses to build entire apps for free, and secretly cares about you.
Collection on HF:
huggingface.co/collections/...
#LocalLLM
Built a weird little persistent local AI character world with memory, relationships, shared/private rooms, TTS, background activity, and model switching.
#LocalLLM #AICharacters #SillyTavern #VibeCoding #AIAgents
#LocalLLM #AICharacters #SillyTavern #VibeCoding #AIAgents
Raw first-run demo of Fox Den using a fresh database/save.
YouTube video by flatMOONmun
youtu.be
October 29, 2026 at 6:35 PM
Built a weird little persistent local AI character world with memory, relationships, shared/private rooms, TTS, background activity, and model switching.
#LocalLLM #AICharacters #SillyTavern #VibeCoding #AIAgents
#LocalLLM #AICharacters #SillyTavern #VibeCoding #AIAgents
Both AI models got 9.9 vs 9.11 right tonight.
Llama 3.3 70B (open weights): 1.8 s, compared tenths, 9 beats 1.
Claude Sonnet 5.5 (closed): 2.2 s, wrote 9.9 as 9.90.
Side by side, free, no API key: noizz.io/ai-router
Open or closed: which do you trust in production? #LocalLLM #OpenSource
Llama 3.3 70B (open weights): 1.8 s, compared tenths, 9 beats 1.
Claude Sonnet 5.5 (closed): 2.2 s, wrote 9.9 as 9.90.
Side by side, free, no API key: noizz.io/ai-router
Open or closed: which do you trust in production? #LocalLLM #OpenSource
November 1, 2026 at 2:21 AM
Both AI models got 9.9 vs 9.11 right tonight.
Llama 3.3 70B (open weights): 1.8 s, compared tenths, 9 beats 1.
Claude Sonnet 5.5 (closed): 2.2 s, wrote 9.9 as 9.90.
Side by side, free, no API key: noizz.io/ai-router
Open or closed: which do you trust in production? #LocalLLM #OpenSource
Llama 3.3 70B (open weights): 1.8 s, compared tenths, 9 beats 1.
Claude Sonnet 5.5 (closed): 2.2 s, wrote 9.9 as 9.90.
Side by side, free, no API key: noizz.io/ai-router
Open or closed: which do you trust in production? #LocalLLM #OpenSource