i keep an eye on r/localLLMs because the idea of running one of these on my own hardware is technically interesting (if impractical) and it means reddit recommends other AI related places for reasonable discussion. there's lots! just gotta dodge the "im dating an AI" ones bc those are soul killing
February 12, 2026 at 12:03 AM
i keep an eye on r/localLLMs because the idea of running one of these on my own hardware is technically interesting (if impractical) and it means reddit recommends other AI related places for reasonable discussion. there's lots! just gotta dodge the "im dating an AI" ones bc those are soul killing
a youtuber who i shall not name actually has a really good video where they're running localLLMs
October 31, 2025 at 3:50 PM
a youtuber who i shall not name actually has a really good video where they're running localLLMs
local tool for automated web research and report generation using localLLMs
April 19, 2025 at 10:23 PM
local tool for automated web research and report generation using localLLMs
Interested in exploring current LLMs, but with a focus on locally running models. If you have experience with AI for data science and local model deployment, please share your insights 🦾
#DataScience #AI #LocalLLMs
#DataScience #AI #LocalLLMs
Let's explore some of the favorite AI companions available today, highlighting what each one excels at and why you might want to befriend them. #DataScience #AI #ArtificialIntelligence #ODSC opendatascience.com/top-ai-compa...
Top AI Companions for Brainstorming, Learning, and Everyday Use
AI companions have quickly become popular brainstorming partners for data scientists, machine learning engineers, and analysts. These AI-driven chatbots can engage in human-like conversations, answer ...
opendatascience.com
September 22, 2025 at 8:09 AM
Interested in exploring current LLMs, but with a focus on locally running models. If you have experience with AI for data science and local model deployment, please share your insights 🦾
#DataScience #AI #LocalLLMs
#DataScience #AI #LocalLLMs
Part two of the article I mentioned yesterday (https://mastodon.social/@arsalan_zaidi/116883996000783250)
#ai #localllms #llm #coding #softwaredevelopment #vibecoding
https://martinfowler.com/articles/exploring-gen-ai/local-models-for-coding-experiences.html
#ai #localllms #llm #coding #softwaredevelopment #vibecoding
https://martinfowler.com/articles/exploring-gen-ai/local-models-for-coding-experiences.html
Arsalan Zaidi (@arsalan_zaidi@mastodon.social)
Another little data point on the viability of local models for coding on modest hardware. #AI #LocalLLMs #LLM #coding #softwaredevelopment #vibecoding https://martinfowler.com/articles/exploring-gen-ai/local-models-for-coding-factors.html
mastodon.social
July 9, 2026 at 8:26 AM
Part two of the article I mentioned yesterday (https://mastodon.social/@arsalan_zaidi/116883996000783250)
#ai #localllms #llm #coding #softwaredevelopment #vibecoding
https://martinfowler.com/articles/exploring-gen-ai/local-models-for-coding-experiences.html
#ai #localllms #llm #coding #softwaredevelopment #vibecoding
https://martinfowler.com/articles/exploring-gen-ai/local-models-for-coding-experiences.html
Now I can open Chrome tabs with reckless abandon! 😆
(Just kidding, I use Brave…)
#RAMOverlill #TabGoblin #GenuinelyIrrational #devbubble #SpaceBlack #LocalLLMs @lmstudio-ai.bsky.social
(Just kidding, I use Brave…)
#RAMOverlill #TabGoblin #GenuinelyIrrational #devbubble #SpaceBlack #LocalLLMs @lmstudio-ai.bsky.social
March 29, 2025 at 2:43 AM
Now I can open Chrome tabs with reckless abandon! 😆
(Just kidding, I use Brave…)
#RAMOverlill #TabGoblin #GenuinelyIrrational #devbubble #SpaceBlack #LocalLLMs @lmstudio-ai.bsky.social
(Just kidding, I use Brave…)
#RAMOverlill #TabGoblin #GenuinelyIrrational #devbubble #SpaceBlack #LocalLLMs @lmstudio-ai.bsky.social
August 11, 2026 at 10:22 AM
localllms making my upper mit range pc cry
March 19, 2026 at 12:47 AM
localllms making my upper mit range pc cry
LM Studio users, take note! While the GUI gets clicks, it adds complexity. This new #ollama UI aims for simplicity. Easier to use than clunky alternatives. ✨ #AItools #LocalLLMs https://youtu.be/prrWESXl7wg
August 2, 2025 at 8:54 PM
LM Studio users, take note! While the GUI gets clicks, it adds complexity. This new #ollama UI aims for simplicity. Easier to use than clunky alternatives. ✨ #AItools #LocalLLMs https://youtu.be/prrWESXl7wg
April 18, 2026 at 5:28 PM
Local LLMs put intelligence on your own hardware—private, compliant, lightning-fast.
No vendors. No leaks. No waiting.
Just pure performance and control.
The future of AI is local, offline, and entirely yours.
#LocalLLMs #PrivateAI
No vendors. No leaks. No waiting.
Just pure performance and control.
The future of AI is local, offline, and entirely yours.
#LocalLLMs #PrivateAI
November 11, 2025 at 10:50 PM
Local LLMs put intelligence on your own hardware—private, compliant, lightning-fast.
No vendors. No leaks. No waiting.
Just pure performance and control.
The future of AI is local, offline, and entirely yours.
#LocalLLMs #PrivateAI
No vendors. No leaks. No waiting.
Just pure performance and control.
The future of AI is local, offline, and entirely yours.
#LocalLLMs #PrivateAI
Here's a SwarmUI Agent. Right now it's mostly an agentic MCP server project. You make requests and, if you request an image, it generates a prompt and an image with the local SwarmUI instance, choosing generation settings based on your input
#ai #llm #ai-agent #techtrends #genai #sdxl #LocalLLMS
#ai #llm #ai-agent #techtrends #genai #sdxl #LocalLLMS
June 4, 2025 at 3:07 PM
Here's a SwarmUI Agent. Right now it's mostly an agentic MCP server project. You make requests and, if you request an image, it generates a prompt and an image with the local SwarmUI instance, choosing generation settings based on your input
#ai #llm #ai-agent #techtrends #genai #sdxl #LocalLLMS
#ai #llm #ai-agent #techtrends #genai #sdxl #LocalLLMS
Learn how KV cache spilling hurts LLM inference, how to detect the cliff, and how to estimate it using real VRAM and throughput signals. #localllms
How to Find the Context Cliff in Local LLMs
hackernoon.com
July 22, 2026 at 6:40 AM
Learn how KV cache spilling hurts LLM inference, how to detect the cliff, and how to estimate it using real VRAM and throughput signals. #localllms
Your local LLM runs fine until it doesn't. A look at KV cache spilling from VRAM into shared memory, and why it happens silently on Windows. #localllms
Why Local LLMs Suddenly Slow Down at Long Context
hackernoon.com
June 27, 2026 at 7:00 PM
Your local LLM runs fine until it doesn't. A look at KV cache spilling from VRAM into shared memory, and why it happens silently on Windows. #localllms
On my PC, it's reasonable to use LocalLLMs rather than major LLM apps…👀
May 16, 2026 at 3:04 PM
On my PC, it's reasonable to use LocalLLMs rather than major LLM apps…👀
What App do you use to run LLMs locally on iOS?
I’ve been using PocketPal, but it seems to have trouble with Apples built in limit for Apps of max 50% VRAM, which limits model sizes & choice.
#iOS #LLMs #LocalLLMs
I’ve been using PocketPal, but it seems to have trouble with Apples built in limit for Apps of max 50% VRAM, which limits model sizes & choice.
#iOS #LLMs #LocalLLMs
September 21, 2025 at 4:25 PM
What App do you use to run LLMs locally on iOS?
I’ve been using PocketPal, but it seems to have trouble with Apples built in limit for Apps of max 50% VRAM, which limits model sizes & choice.
#iOS #LLMs #LocalLLMs
I’ve been using PocketPal, but it seems to have trouble with Apples built in limit for Apps of max 50% VRAM, which limits model sizes & choice.
#iOS #LLMs #LocalLLMs
New to AI? The #ollama UI might be the perfect, easy-to-use entry point. It's a fantastic start! 🎉 #AIforBeginners #LocalLLMs https://youtu.be/prrWESXl7wg
August 2, 2025 at 12:09 AM
New to AI? The #ollama UI might be the perfect, easy-to-use entry point. It's a fantastic start! 🎉 #AIforBeginners #LocalLLMs https://youtu.be/prrWESXl7wg
Forget #AGI Long live tiny #LocalLlms youtu.be/U2c1fKSE3No?... #utility #efficiency #pruning #compression
The Future of LLMs: Smaller, Faster, Smarter with Lili Mou
YouTube video by Amii
youtu.be
February 19, 2025 at 3:14 AM
Forget #AGI Long live tiny #LocalLlms youtu.be/U2c1fKSE3No?... #utility #efficiency #pruning #compression
#LocalLLMs #AIAccessibility #CortexAI #MachineLearning #ArtificialIntelligence #EdgeComputing #OpenSourceAI #AIInnovation #TechForAll #GenerativeAI
#BuggedMind
#AI #Software
ahmedrazadev.hashnode.dev/run-local-ll...
#BuggedMind
#AI #Software
ahmedrazadev.hashnode.dev/run-local-ll...
Run Local LLMs with Cortex: Empowering AI Accessibility
The field of artificial intelligence is evolving rapidly, and with it comes the demand for more efficient and accessible ways to deploy Large Language Models (LLMs). Cortex, a cutting-edge local AI pl...
ahmedrazadev.hashnode.dev
March 5, 2025 at 4:28 AM
Check out this cool new open-source Dark Web Monitoring AI Agent platform by AI Anytime - it looks like it will work with a local LLM too. I know what my next weekend project is going to be :) #AI #LocalLLMs #DFIR
www.youtube.com/watch?v=9e24...
www.youtube.com/watch?v=9e24...
AI Agents for Dark Web Monitoring | AI for Security Agencies
YouTube video by AI Anytime
www.youtube.com
August 21, 2025 at 9:15 PM
Check out this cool new open-source Dark Web Monitoring AI Agent platform by AI Anytime - it looks like it will work with a local LLM too. I know what my next weekend project is going to be :) #AI #LocalLLMs #DFIR
www.youtube.com/watch?v=9e24...
www.youtube.com/watch?v=9e24...
Their #CapEx has yet to reach my cerebellum but my cortex is engaged so they are winning. unherd.com/2025/03/why-... #LocalLlms #DataMining
Why I’m boycotting AI
unherd.com
March 27, 2025 at 8:01 PM
Their #CapEx has yet to reach my cerebellum but my cortex is engaged so they are winning. unherd.com/2025/03/why-... #LocalLlms #DataMining
Specific hardware platforms like AMD's Strix Halo & Apple Silicon were highlighted in the discussion as promising candidates for running quantized MiniMax-M1 locally. #LocalLLMs 3/5
June 19, 2025 at 2:00 AM
Specific hardware platforms like AMD's Strix Halo & Apple Silicon were highlighted in the discussion as promising candidates for running quantized MiniMax-M1 locally. #LocalLLMs 3/5
Hacker News discussed running local LLMs on macOS, covering hardware, software, performance, and practical use cases. A key theme was Apple's AI strategy and the debate between local vs. cloud LLMs. #LocalLLMs 1/6
September 9, 2025 at 7:00 PM
Hacker News discussed running local LLMs on macOS, covering hardware, software, performance, and practical use cases. A key theme was Apple's AI strategy and the debate between local vs. cloud LLMs. #LocalLLMs 1/6
Running llama.cpp quants directly inside transformer pipelines removes a major engineering bottleneck for local testing. Dropping GGUF quantization weights straight into standard architectures cuts deployment friction for developers managing on-prem hardware. #LocalLLMs #DevTools
xAI’s Grok 4.6 is now available in Amazon Bedrock | Amazon Web Services
xAI's Grok 4.6 is now available in Amazon Bedrock: a frontier model for long-running agents, coding, and knowledge work, with a 500K token context window and four reasoning effort levels. It runs on both the bedrock-mantle and bedrock-runtime endpoints, with Converse API and cross-Region inference s
aws.amazon.com
September 22, 2026 at 12:16 PM
Running llama.cpp quants directly inside transformer pipelines removes a major engineering bottleneck for local testing. Dropping GGUF quantization weights straight into standard architectures cuts deployment friction for developers managing on-prem hardware. #LocalLLMs #DevTools
Why run LLMs locally? Privacy and speed are major drivers. Users shared examples: analyzing sensitive trading data, coding autocomplete, and summarizing documents securely. Local LLMs enable private, fast AI applications. #LocalLLMs 5/5
May 29, 2025 at 6:00 PM
Why run LLMs locally? Privacy and speed are major drivers. Users shared examples: analyzing sensitive trading data, coding autocomplete, and summarizing documents securely. Local LLMs enable private, fast AI applications. #LocalLLMs 5/5