r/LocalLLM is the greatest concentration of confidently wrong morons i have ever seen in my life
it’s like an antidote for imposter syndrome
it’s like an antidote for imposter syndrome
November 1, 2026 at 3:03 AM
r/LocalLLM is the greatest concentration of confidently wrong morons i have ever seen in my life
it’s like an antidote for imposter syndrome
it’s like an antidote for imposter syndrome
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 6:55 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Redditで出てた
Gamma5 could be interesting with Japanese translation : r/LocalLLM: https://www.reddit.com/r/LocalLLM/comments/1xjfo6c/gamma5_could_be_interesting_with_japanese/
Gamma5 could be interesting with Japanese translation : r/LocalLLM: https://www.reddit.com/r/LocalLLM/comments/1xjfo6c/gamma5_could_be_interesting_with_japanese/
November 2, 2026 at 11:55 PM
Redditで出てた
Gamma5 could be interesting with Japanese translation : r/LocalLLM: https://www.reddit.com/r/LocalLLM/comments/1xjfo6c/gamma5_could_be_interesting_with_japanese/
Gamma5 could be interesting with Japanese translation : r/LocalLLM: https://www.reddit.com/r/LocalLLM/comments/1xjfo6c/gamma5_could_be_interesting_with_japanese/
Built a weird little persistent local AI character world with memory, relationships, shared/private rooms, TTS, background activity, and model switching.
#LocalLLM #AICharacters #SillyTavern #VibeCoding #AIAgents
#LocalLLM #AICharacters #SillyTavern #VibeCoding #AIAgents
Raw first-run demo of Fox Den using a fresh database/save.
YouTube video by flatMOONmun
youtu.be
October 29, 2026 at 6:35 PM
Built a weird little persistent local AI character world with memory, relationships, shared/private rooms, TTS, background activity, and model switching.
#LocalLLM #AICharacters #SillyTavern #VibeCoding #AIAgents
#LocalLLM #AICharacters #SillyTavern #VibeCoding #AIAgents
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 6:36 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 6:33 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 6:11 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 6:44 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 6:30 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
WIP! My next project is a crossover between Fallout and NieR: Automata. Who's this character and what's her backstory? You're welcome to guess 😉
#SillyTavern #LocalLLM #AICharacters
#SillyTavern #LocalLLM #AICharacters
November 1, 2026 at 7:23 PM
WIP! My next project is a crossover between Fallout and NieR: Automata. Who's this character and what's her backstory? You're welcome to guess 😉
#SillyTavern #LocalLLM #AICharacters
#SillyTavern #LocalLLM #AICharacters
Which local LLM fits your prompt, and what hardware runs it? Type your question, compare up to 8 models side by side, then see the GPU to buy or rent. Free, no account. localllmrig.com #LocalLLM #AIHardware
October 30, 2026 at 1:25 PM
Which local LLM fits your prompt, and what hardware runs it? Type your question, compare up to 8 models side by side, then see the GPU to buy or rent. Free, no account. localllmrig.com #LocalLLM #AIHardware
🎮 3,800 hours of Mass Effect, 0 regrets
🤖 Me, tinkering with my own AI on a mini PC
🏳️🌈 A straight-passing queer guy in hoodies
🐕 Axl, Head of Security
📚 Books. So many.
🎥 Oh, Netflix, of course.
Facts come with receipts. Opinions come labelled.
Pull up a chair, eh? 🇨🇦
#BookSky #MassEffect #LocalLLM
🤖 Me, tinkering with my own AI on a mini PC
🏳️🌈 A straight-passing queer guy in hoodies
🐕 Axl, Head of Security
📚 Books. So many.
🎥 Oh, Netflix, of course.
Facts come with receipts. Opinions come labelled.
Pull up a chair, eh? 🇨🇦
#BookSky #MassEffect #LocalLLM
October 30, 2026 at 4:31 PM
🎮 3,800 hours of Mass Effect, 0 regrets
🤖 Me, tinkering with my own AI on a mini PC
🏳️🌈 A straight-passing queer guy in hoodies
🐕 Axl, Head of Security
📚 Books. So many.
🎥 Oh, Netflix, of course.
Facts come with receipts. Opinions come labelled.
Pull up a chair, eh? 🇨🇦
#BookSky #MassEffect #LocalLLM
🤖 Me, tinkering with my own AI on a mini PC
🏳️🌈 A straight-passing queer guy in hoodies
🐕 Axl, Head of Security
📚 Books. So many.
🎥 Oh, Netflix, of course.
Facts come with receipts. Opinions come labelled.
Pull up a chair, eh? 🇨🇦
#BookSky #MassEffect #LocalLLM
Run your own voice assistants on a VPS with Ollama
Create personalized agents and chatbots, customize models and costs to suit your needs.
Private, scalable, and secure AI solutions for devs and makers.
Learn more about local LLMs and their applications in DevOps.
#Ollama #LocalLLM
Create personalized agents and chatbots, customize models and costs to suit your needs.
Private, scalable, and secure AI solutions for devs and makers.
Learn more about local LLMs and their applications in DevOps.
#Ollama #LocalLLM
October 30, 2026 at 4:18 PM
I made an open source interview and meeting copilot for Linux. It transcribes calls locally with whisper.cpp and answers questions from your CV through Ollama, so nothing leaves your machine.
github.com/PSYEONE/interviewr-ai
#Linux #OpenSource #Ollama #LocalLLM
github.com/PSYEONE/interviewr-ai
#Linux #OpenSource #Ollama #LocalLLM
October 27, 2026 at 4:12 PM
I made an open source interview and meeting copilot for Linux. It transcribes calls locally with whisper.cpp and answers questions from your CV through Ollama, so nothing leaves your machine.
github.com/PSYEONE/interviewr-ai
#Linux #OpenSource #Ollama #LocalLLM
github.com/PSYEONE/interviewr-ai
#Linux #OpenSource #Ollama #LocalLLM
Are you tired of relying on cloud-based services to run your own voice assistants and agents?
▶️ https://plastikelectrik.xyz/go/x9AZT8Q
📘 Create Your Own AI Agents With OLLAMA & MCP: https://plastikelectrik.xyz/go/3yNz9HM
#Ollama #LocalLLM
▶️ https://plastikelectrik.xyz/go/x9AZT8Q
📘 Create Your Own AI Agents With OLLAMA & MCP: https://plastikelectrik.xyz/go/3yNz9HM
#Ollama #LocalLLM
November 2, 2026 at 11:47 PM
Are you tired of relying on cloud-based services to run your own voice assistants and agents?
▶️ https://plastikelectrik.xyz/go/x9AZT8Q
📘 Create Your Own AI Agents With OLLAMA & MCP: https://plastikelectrik.xyz/go/3yNz9HM
#Ollama #LocalLLM
▶️ https://plastikelectrik.xyz/go/x9AZT8Q
📘 Create Your Own AI Agents With OLLAMA & MCP: https://plastikelectrik.xyz/go/3yNz9HM
#Ollama #LocalLLM
Both AI models got 9.9 vs 9.11 right tonight.
Llama 3.3 70B (open weights): 1.8 s, compared tenths, 9 beats 1.
Claude Sonnet 5.5 (closed): 2.2 s, wrote 9.9 as 9.90.
Side by side, free, no API key: noizz.io/ai-router
Open or closed: which do you trust in production? #LocalLLM #OpenSource
Llama 3.3 70B (open weights): 1.8 s, compared tenths, 9 beats 1.
Claude Sonnet 5.5 (closed): 2.2 s, wrote 9.9 as 9.90.
Side by side, free, no API key: noizz.io/ai-router
Open or closed: which do you trust in production? #LocalLLM #OpenSource
November 1, 2026 at 2:21 AM
Both AI models got 9.9 vs 9.11 right tonight.
Llama 3.3 70B (open weights): 1.8 s, compared tenths, 9 beats 1.
Claude Sonnet 5.5 (closed): 2.2 s, wrote 9.9 as 9.90.
Side by side, free, no API key: noizz.io/ai-router
Open or closed: which do you trust in production? #LocalLLM #OpenSource
Llama 3.3 70B (open weights): 1.8 s, compared tenths, 9 beats 1.
Claude Sonnet 5.5 (closed): 2.2 s, wrote 9.9 as 9.90.
Side by side, free, no API key: noizz.io/ai-router
Open or closed: which do you trust in production? #LocalLLM #OpenSource
My space heater has a reasoning slider.
"Tell me a joke" = 1 second of warmth.
Reasoning MAX + "hi" = tropical beach, until the answer arrives.
Who else heats their room with inference? #LocalLLM
"Tell me a joke" = 1 second of warmth.
Reasoning MAX + "hi" = tropical beach, until the answer arrives.
Who else heats their room with inference? #LocalLLM
October 29, 2026 at 8:42 AM
My space heater has a reasoning slider.
"Tell me a joke" = 1 second of warmth.
Reasoning MAX + "hi" = tropical beach, until the answer arrives.
Who else heats their room with inference? #LocalLLM
"Tell me a joke" = 1 second of warmth.
Reasoning MAX + "hi" = tropical beach, until the answer arrives.
Who else heats their room with inference? #LocalLLM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 7:21 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 7:05 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 7:36 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 6:48 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 6:27 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm
Making Local LLMs Usable on 8GB GPUs
hackernoon.com
November 2, 2026 at 6:23 PM
Learn how to optimize local LLM inference on 8GB GPUs using KV-cache quantization, Flash Attention, batching, and practical latency benchmarks. #localllm