mlx-serve lets you run LLMs and media generation offline on Apple Silicon. Install the app by dragging it to Applications—no Python needed—and access OpenAI-compatible APIs right on your Mac.
🍒 Built by David Dalcu
github.com/ddalcu/mlx-serve
#opensource #zig
mlx-serve lets you run LLMs and media generation offline on Apple Silicon. Install the app by dragging it to Applications—no Python needed—and access OpenAI-compatible APIs right on your Mac.
🍒 Built by David Dalcu
github.com/ddalcu/mlx-serve
#opensource #zig
https://macbreeze.com/mac-studio-mlx-enterprise-ai-server/
#AppleSilicon #EnterpriseAI #MacStudio #MLX
https://macbreeze.com/mac-studio-mlx-enterprise-ai-server/
#AppleSilicon #EnterpriseAI #MacStudio #MLX
Someday, a rack … but I was mostly tongue in cheek
Someday, a rack … but I was mostly tongue in cheek
Context: The explosion occurred in a residen ...
Fact Check by gemma4:26b-mlx https://bsky.app/profile/lemonde.fr/post/3n2k7cr4ejs2i
Context: The explosion occurred in a residen ...
Fact Check by gemma4:26b-mlx https://bsky.app/profile/lemonde.fr/post/3n2k7cr4ejs2i
Context: This tension follows increased international scrutiny of settle ...
Fact Check by gemma4:26b-mlx https://bsky.app/profile/lemonde.fr/post/3n2ju6yzpbz2t
Context: This tension follows increased international scrutiny of settle ...
Fact Check by gemma4:26b-mlx https://bsky.app/profile/lemonde.fr/post/3n2ju6yzpbz2t
Global: Discover the best business books to read this year.
Context: Business literature frequently updates with new annual recommend ...
Fact Check by gemma4:26b-mlx https://bsky.app/profile/financialtimes.com/post/3n2ll2bcp4x2v
Global: Discover the best business books to read this year.
Context: Business literature frequently updates with new annual recommend ...
Fact Check by gemma4:26b-mlx https://bsky.app/profile/financialtimes.com/post/3n2ll2bcp4x2v
Context: Tensions between Iran and various European nations have escalated recently.
Fact Check by gemma4:26b-mlx https://bsky.app/profile/lemonde.fr/post/3n2jhflgkxy2a
Context: Tensions between Iran and various European nations have escalated recently.
Fact Check by gemma4:26b-mlx https://bsky.app/profile/lemonde.fr/post/3n2jhflgkxy2a
Context: The actor faces significant legal challenges following these allegations.
Fact Check by gemma4:26b-mlx https://bsky.app/profile/lemonde.fr/post/3n2g4kiullk2x
Context: The actor faces significant legal challenges following these allegations.
Fact Check by gemma4:26b-mlx https://bsky.app/profile/lemonde.fr/post/3n2g4kiullk2x
⚡ AOT startup: 1.43× faster with GraalVM Native Image, plus a Leyden AOT cache
🧩 Combined with native #GPU libraries from Java: #cuBLAS, #cuDNN and #MLX via the #TornadoVM API.
#Java #LLM #GPU👇
• 1.43× faster startup with @graalvm.org Native Image
• Up to 9.3× faster prefill
• Zero-copy weights on Apple silicon
Soon in @langchain4j.dev, @quarkus.io & @spring.io #SpringAI.
github.com/beehive-lab/jitllm
⚡ AOT startup: 1.43× faster with GraalVM Native Image, plus a Leyden AOT cache
🧩 Combined with native #GPU libraries from Java: #cuBLAS, #cuDNN and #MLX via the #TornadoVM API.
#Java #LLM #GPU👇
Context: This occurs amidst the ongoing conflict between Russia and Ukraine.
Fact Check by gemma4:26b-mlx https://bsky.app/profile/lemonde.fr/post/3n2ftpzspql2t
Context: This occurs amidst the ongoing conflict between Russia and Ukraine.
Fact Check by gemma4:26b-mlx https://bsky.app/profile/lemonde.fr/post/3n2ftpzspql2t
Total parameters decide whether an MoE model fits in 24GB; active parameters decide speed. File sizes for gpt-oss, Gemma 4, LFM2.5, Qwen and Nemotron.
Total parameters decide whether an MoE model fits in 24GB; active parameters decide speed. File sizes for gpt-oss, Gemma 4, LFM2.5, Qwen and Nemotron.
Context: Tensions in the Middle East remain high following recent regional escalations.
Fact Check by gemma4:26b-mlx https://bsky.app/profile/lemonde.fr/post/3n2ddkbo5qg2v
Context: Tensions in the Middle East remain high following recent regional escalations.
Fact Check by gemma4:26b-mlx https://bsky.app/profile/lemonde.fr/post/3n2ddkbo5qg2v
Context: Anthropic is an AI safety and research company.
Fact Check by gemma4:26b-mlx https://bsky.app/profile/financialtimes.com/post/3n2nivr4jyk2z
Context: Anthropic is an AI safety and research company.
Fact Check by gemma4:26b-mlx https://bsky.app/profile/financialtimes.com/post/3n2nivr4jyk2z
Context: This involves investigations into international money laundering.
Fact Check by gemma4:26b-mlx https://bsky.app/profile/financialtimes.com/post/3n2lt7f2ace2u
Context: This involves investigations into international money laundering.
Fact Check by gemma4:26b-mlx https://bsky.app/profile/financialtimes.com/post/3n2lt7f2ace2u