Holy shit, I'm actually running an AI model on my Mac Studio (Qwen3.8-27B-4bit) :0
September 7, 2026 at 7:46 PM
Holy shit, I'm actually running an AI model on my Mac Studio (Qwen3.8-27B-4bit) :0
Actually I specifically remember the exchange, the clerk clarified "The Nintendo...EF?" bsky.app/profile/4bit...
"you got the nintendo ds thing?"
"the huh?????"
"the huh?????"
November 21, 2024 at 8:46 PM
Actually I specifically remember the exchange, the clerk clarified "The Nintendo...EF?" bsky.app/profile/4bit...
Minimum wage tracks the average tokens per second one achieves with Qwen4 ultra 4bit quant
September 16, 2026 at 4:27 PM
Minimum wage tracks the average tokens per second one achieves with Qwen4 ultra 4bit quant
me: tokio-tungstenite
qwen3-asr-1.7b-4bit: TOKYO TANKS TONITE!?!??
qwen3-asr-1.7b-4bit: TOKYO TANKS TONITE!?!??
April 2, 2026 at 4:34 PM
me: tokio-tungstenite
qwen3-asr-1.7b-4bit: TOKYO TANKS TONITE!?!??
qwen3-asr-1.7b-4bit: TOKYO TANKS TONITE!?!??
December 12, 2024 at 7:29 PM
New inference demand just dropped! This feature prefers Qwen2.5-7B-Instruct-4bit / gemma-4-12b / gemma-3-4b-it-qat-4bit in that order so start hosting those and make sure you're updated to the latest version!
Miss a day? Now your feed catches you up. Feed Pulse reads the posts your readers actually looked at, and writes a short daily front page for you - all through @cocore.dev's artisanal, farm-to-table AI inference ATProto co-op! Available *today* for all feeds.
September 17, 2026 at 3:16 PM
New inference demand just dropped! This feature prefers Qwen2.5-7B-Instruct-4bit / gemma-4-12b / gemma-3-4b-it-qat-4bit in that order so start hosting those and make sure you're updated to the latest version!
New LLM plugin for running models on macOS using Apple's MLX framework:
llm install llm-mlx
llm mlx download-model mlx-community/Llama-3.2-3B-Instruct-4bit
llm -m mlx-community/Llama-3.2-3B-Instruct-4bit 'Python code to traverse a tree'
simonwillison.net/2025/Feb/15/...
llm install llm-mlx
llm mlx download-model mlx-community/Llama-3.2-3B-Instruct-4bit
llm -m mlx-community/Llama-3.2-3B-Instruct-4bit 'Python code to traverse a tree'
simonwillison.net/2025/Feb/15/...
Run LLMs on macOS using llm-mlx and Apple’s MLX framework
llm-mlx is a brand new plugin for my LLM Python Library and CLI utility which builds on top of Apple’s excellent MLX array framework library and mlx-lm package. If you’re …
simonwillison.net
February 15, 2025 at 7:14 PM
New LLM plugin for running models on macOS using Apple's MLX framework:
llm install llm-mlx
llm mlx download-model mlx-community/Llama-3.2-3B-Instruct-4bit
llm -m mlx-community/Llama-3.2-3B-Instruct-4bit 'Python code to traverse a tree'
simonwillison.net/2025/Feb/15/...
llm install llm-mlx
llm mlx download-model mlx-community/Llama-3.2-3B-Instruct-4bit
llm -m mlx-community/Llama-3.2-3B-Instruct-4bit 'Python code to traverse a tree'
simonwillison.net/2025/Feb/15/...
writing a nice little davinci plugin for dithering that i'm sure i'll use eventually
June 4, 2026 at 5:15 AM
writing a nice little davinci plugin for dithering that i'm sure i'll use eventually
Meet the boys of 4bit!
nanomew.itch.io/4bit
Umi route out now!
__________________________
#4bit #VisualNovel #RenPy #Otome #Yandere #SciFi #Kpop
nanomew.itch.io/4bit
Umi route out now!
__________________________
#4bit #VisualNovel #RenPy #Otome #Yandere #SciFi #Kpop
4bit by Nanomew
Available for Windows, macOS, Android
nanomew.itch.io
August 23, 2026 at 4:23 AM
Meet the boys of 4bit!
nanomew.itch.io/4bit
Umi route out now!
__________________________
#4bit #VisualNovel #RenPy #Otome #Yandere #SciFi #Kpop
nanomew.itch.io/4bit
Umi route out now!
__________________________
#4bit #VisualNovel #RenPy #Otome #Yandere #SciFi #Kpop
August 24, 2026 at 9:02 PM
DeepSeek-R1-0528-Qwen3-8B is pretty good and fits in half my vram as a 4bit quantize so it goes really quick even locally
May 30, 2025 at 10:52 PM
DeepSeek-R1-0528-Qwen3-8B is pretty good and fits in half my vram as a 4bit quantize so it goes really quick even locally
August 29, 2026 at 10:10 PM
May 13, 2026 at 6:06 AM
Added a couple more example models to my post which I've now confirmed work great with llm-mlx:
mlx-community/Mistral-Small-24B-Instruct-2501-4bit - 13GB, GPT-4 quality results for only ~12GB of RAM usage
mlx-community/DeepSeek-R1-Distill-Qwen-32B-4bit - 18GB, neat demo of "reasoning" model
mlx-community/Mistral-Small-24B-Instruct-2501-4bit - 13GB, GPT-4 quality results for only ~12GB of RAM usage
mlx-community/DeepSeek-R1-Distill-Qwen-32B-4bit - 18GB, neat demo of "reasoning" model
February 17, 2025 at 12:06 AM
Added a couple more example models to my post which I've now confirmed work great with llm-mlx:
mlx-community/Mistral-Small-24B-Instruct-2501-4bit - 13GB, GPT-4 quality results for only ~12GB of RAM usage
mlx-community/DeepSeek-R1-Distill-Qwen-32B-4bit - 18GB, neat demo of "reasoning" model
mlx-community/Mistral-Small-24B-Instruct-2501-4bit - 13GB, GPT-4 quality results for only ~12GB of RAM usage
mlx-community/DeepSeek-R1-Distill-Qwen-32B-4bit - 18GB, neat demo of "reasoning" model
Palette challenge at PAC, from July 2025.
Colors: 7
Canvas: 80x80
Frames: 15
#pixels #pixelart #pixelartanimation #animation #palettechallenge #4bit #8bit #pixelartist #ladyginger #pacdiscord #PixelArtCommunity
Colors: 7
Canvas: 80x80
Frames: 15
#pixels #pixelart #pixelartanimation #animation #palettechallenge #4bit #8bit #pixelartist #ladyginger #pacdiscord #PixelArtCommunity
December 25, 2025 at 9:13 AM
Palette challenge at PAC, from July 2025.
Colors: 7
Canvas: 80x80
Frames: 15
#pixels #pixelart #pixelartanimation #animation #palettechallenge #4bit #8bit #pixelartist #ladyginger #pacdiscord #PixelArtCommunity
Colors: 7
Canvas: 80x80
Frames: 15
#pixels #pixelart #pixelartanimation #animation #palettechallenge #4bit #8bit #pixelartist #ladyginger #pacdiscord #PixelArtCommunity
Let’s talk about bit depth. The rule of thumb is to use one bit for each instrument in your track. So if you’re recording a rock band, 4bit is usually good enough. If it’s a jazz orchestra, maybe 16 or so. If you’re recoding a symphony orchestra I wouldn’t go below a bit depth of 32.
November 18, 2025 at 1:09 PM
Let’s talk about bit depth. The rule of thumb is to use one bit for each instrument in your track. So if you’re recording a rock band, 4bit is usually good enough. If it’s a jazz orchestra, maybe 16 or so. If you’re recoding a symphony orchestra I wouldn’t go below a bit depth of 32.
August 24, 2026 at 12:30 AM
50 minutes video of DS4-agent building a small programming language. Mixed 2bit/4bit (last six layers) quants running on M3 Max. Video is not accelerated, real speed. www.youtube.com/watch?v=YD7F...
40 minutes of DS4-agent building a small programming language
YouTube video by Salvatore Sanfilippo
www.youtube.com
May 20, 2026 at 4:45 PM
50 minutes video of DS4-agent building a small programming language. Mixed 2bit/4bit (last six layers) quants running on M3 Max. Video is not accelerated, real speed. www.youtube.com/watch?v=YD7F...
I'm implement GLM 5.2 in DwarfStart with support for 2bit and 4bit quants, SSD streaming, and so forth. With Metal it already works well. CUDA / ROCm work still to do.
June 26, 2026 at 9:33 AM
I'm implement GLM 5.2 in DwarfStart with support for 2bit and 4bit quants, SSD streaming, and so forth. With Metal it already works well. CUDA / ROCm work still to do.
Challenge: Poison, poisonous or venomous.
Size: 35x40
Colors: 12
Time spend: 1 hour
#ladyginger #pixelart #pixelartist #pixels #4bit #frog #frogpixels #frogclique #pixelartchallenge
Size: 35x40
Colors: 12
Time spend: 1 hour
#ladyginger #pixelart #pixelartist #pixels #4bit #frog #frogpixels #frogclique #pixelartchallenge
June 25, 2026 at 7:59 AM
Challenge: Poison, poisonous or venomous.
Size: 35x40
Colors: 12
Time spend: 1 hour
#ladyginger #pixelart #pixelartist #pixels #4bit #frog #frogpixels #frogclique #pixelartchallenge
Size: 35x40
Colors: 12
Time spend: 1 hour
#ladyginger #pixelart #pixelartist #pixels #4bit #frog #frogpixels #frogclique #pixelartchallenge
■アイナナ公式動画 超個人的布教ツリー
（ŹOOĻメイン）
✦興収30億円超え劇場版のŹOOĻパートPV〈3DCG〉
✦ŹOOĻに沼った原因
『劇場版アイドリッシュセブン LIVE 4bit BEYOND THE PERiOD』グループPV＜ŹOOĻ＞
youtu.be/z6-RTTnXWfg?...
（ŹOOĻメイン）
✦興収30億円超え劇場版のŹOOĻパートPV〈3DCG〉
✦ŹOOĻに沼った原因
『劇場版アイドリッシュセブン LIVE 4bit BEYOND THE PERiOD』グループPV＜ŹOOĻ＞
youtu.be/z6-RTTnXWfg?...
『劇場版アイドリッシュセブン LIVE 4bit BEYOND THE PERiOD』グループPV＜ŹOOĻ＞
YouTube video by 大神万理
youtu.be
October 23, 2024 at 5:10 PM
■アイナナ公式動画 超個人的布教ツリー
（ŹOOĻメイン）
✦興収30億円超え劇場版のŹOOĻパートPV〈3DCG〉
✦ŹOOĻに沼った原因
『劇場版アイドリッシュセブン LIVE 4bit BEYOND THE PERiOD』グループPV＜ŹOOĻ＞
youtu.be/z6-RTTnXWfg?...
（ŹOOĻメイン）
✦興収30億円超え劇場版のŹOOĻパートPV〈3DCG〉
✦ŹOOĻに沼った原因
『劇場版アイドリッシュセブン LIVE 4bit BEYOND THE PERiOD』グループPV＜ŹOOĻ＞
youtu.be/z6-RTTnXWfg?...