DeepSeek-V4.1-Flash-1017 on one RTX 3090: Big updates to the Delta Inference Engine v0.93. Same 41 tok/s at 192GB/IQ2 at better quality, usable from 64 GB RAM, first token ~40% soo…
https://www.reddit.com/r/LocalLLaMA/comments/1xoq4vq/deepseekv41flash1017_on_one_rtx_3090_big_u
DeepSeek-V4.1-Flash-1017 on one RTX 3090: Big updates to the Delta Inference Engine v0.93. Same 41 tok/s at 192GB/IQ2 at better quality, usable from 64 GB RAM, first token ~40% soo…
https://www.reddit.com/r/LocalLLaMA/comments/1xoq4vq/deepseekv41flash1017_on_one_rtx_3090_big_u
[Paper] SpecOPD: Branch-Parallel On-Policy Distillation for Speculative Decoding - By Qwen
https://www.reddit.com/r/LocalLLaMA/comments/1xoo0pp/paper_specopd_branchparallel_onpolicy/
#IA #AI #ML
[Paper] SpecOPD: Branch-Parallel On-Policy Distillation for Speculative Decoding - By Qwen
https://www.reddit.com/r/LocalLLaMA/comments/1xoo0pp/paper_specopd_branchparallel_onpolicy/
#IA #AI #ML
Qwen3-27B、品質が急低下
発売時はRTX4090で完璧に動作していたが、最近は基本的な指示も失敗・忘却が頻発。
ユーザーは「密かに量子化されて劣化した」と疑念。
🔗 https://www.reddit.com/r/LocalLLaMA/comments/1xoeeyf/qwen3827b_has_become_unuseable_recently/ #AI #人工知能 #LocalLLaMA
Qwen3-27B、品質が急低下
発売時はRTX4090で完璧に動作していたが、最近は基本的な指示も失敗・忘却が頻発。
ユーザーは「密かに量子化されて劣化した」と疑念。
🔗 https://www.reddit.com/r/LocalLLaMA/comments/1xoeeyf/qwen3827b_has_become_unuseable_recently/ #AI #人工知能 #LocalLLaMA
My first experience with agentic AI
https://www.reddit.com/r/LocalLLaMA/comments/1xohbd3/my_first_experience_with_agentic_ai/
#IA #AI #ML
My first experience with agentic AI
https://www.reddit.com/r/LocalLLaMA/comments/1xohbd3/my_first_experience_with_agentic_ai/
#IA #AI #ML
Rather Qwen4-27b at 1M ctx than a big MOE at 128k
https://www.reddit.com/r/LocalLLaMA/comments/1xoh2s7/rather_qwen427b_at_1m_ctx_than_a_big_moe_at_128k/
#IA #AI #ML
Rather Qwen4-27b at 1M ctx than a big MOE at 128k
https://www.reddit.com/r/LocalLLaMA/comments/1xoh2s7/rather_qwen427b_at_1m_ctx_than_a_big_moe_at_128k/
#IA #AI #ML
Quantization livestream with goats of inference
https://www.reddit.com/r/LocalLLaMA/comments/1xoglot/quantization_livestream_with_goats_of_inference/
#IA #AI #ML
Quantization livestream with goats of inference
https://www.reddit.com/r/LocalLLaMA/comments/1xoglot/quantization_livestream_with_goats_of_inference/
#IA #AI #ML
NVIDIA RTX PRO 5500 Blackwell appears at $17,999 MSRP, higher than RTX PRO 6000 at $16,000 MSRP set some months ago by NVIDIA - VideoCardz
https://www.reddit.com/r/LocalLLaMA/comments/1xojryw/nvidia_rtx_pro_5500_blackwell_appears_at_17999/
#IA #AI #ML
NVIDIA RTX PRO 5500 Blackwell appears at $17,999 MSRP, higher than RTX PRO 6000 at $16,000 MSRP set some months ago by NVIDIA - VideoCardz
https://www.reddit.com/r/LocalLLaMA/comments/1xojryw/nvidia_rtx_pro_5500_blackwell_appears_at_17999/
#IA #AI #ML
Anything beat Qwen 3.8 27B yet?
https://www.reddit.com/r/LocalLLaMA/comments/1xoe1wc/anything_beat_qwen_38_27b_yet/
#IA #AI #ML
Anything beat Qwen 3.8 27B yet?
https://www.reddit.com/r/LocalLLaMA/comments/1xoe1wc/anything_beat_qwen_38_27b_yet/
#IA #AI #ML
baidu/ERNIE-5.5-Flash-Base · Hugging Face
https://www.reddit.com/r/LocalLLaMA/comments/1xobtwx/baiduernie55flashbase_hugging_face/
#IA #AI #ML
baidu/ERNIE-5.5-Flash-Base · Hugging Face
https://www.reddit.com/r/LocalLLaMA/comments/1xobtwx/baiduernie55flashbase_hugging_face/
#IA #AI #ML
Qwen be like
https://www.reddit.com/r/LocalLLaMA/comments/1xobzg3/qwen_be_like/
#IA #AI #ML
Qwen be like
https://www.reddit.com/r/LocalLLaMA/comments/1xobzg3/qwen_be_like/
#IA #AI #ML
Qwen3.8-27B has become unuseable recently
https://www.reddit.com/r/LocalLLaMA/comments/1xoeeyf/qwen3827b_has_become_unuseable_recently/
#IA #AI #ML
Qwen3.8-27B has become unuseable recently
https://www.reddit.com/r/LocalLLaMA/comments/1xoeeyf/qwen3827b_has_become_unuseable_recently/
#IA #AI #ML
https://www.reddit.com/r/LocalLLaMA/comments/1xn568h/british_fintech_revolut_slashes_ai_coding_costs/
#ずんつむ
https://www.reddit.com/r/LocalLLaMA/comments/1xn568h/british_fintech_revolut_slashes_ai_coding_costs/
#ずんつむ
Sur r/LocalLLaMA, un internaute demande si quelqu'un a déjà testé le modèle Qwen3.8-27B QSA. Il renvoie vers deux dépôts Hugging Face : une version GGUF (GSQ-RCO) et une version BF16. Selon lui,…
#IA #OpenClaw
Sur r/LocalLLaMA, un internaute demande si quelqu'un a déjà testé le modèle Qwen3.8-27B QSA. Il renvoie vers deux dépôts Hugging Face : une version GGUF (GSQ-RCO) et une version BF16. Selon lui,…
#IA #OpenClaw
CCORE GLB-3D-Coder 4B final model and full weights are out
https://www.reddit.com/r/LocalLLaMA/comments/1xobe4h/ccore_glb3dcoder_4b_final_model_and_full_weights/
#IA #AI #ML
CCORE GLB-3D-Coder 4B final model and full weights are out
https://www.reddit.com/r/LocalLLaMA/comments/1xobe4h/ccore_glb3dcoder_4b_final_model_and_full_weights/
#IA #AI #ML
Abdur-Rahman Butler, ingénieur machine learning chez Isaacus, publie sur r/LocalLLaMA un guide interactif sur les embeddings vectoriels, inspiré de la visualisation de LLM de Brendan Bycroft. Il y fait jouer…
#IA #OpenClaw
Abdur-Rahman Butler, ingénieur machine learning chez Isaacus, publie sur r/LocalLLaMA un guide interactif sur les embeddings vectoriels, inspiré de la visualisation de LLM de Brendan Bycroft. Il y fait jouer…
#IA #OpenClaw
Their stated distaste *capabilities* of cloud air, such as their ChatGPT builds, does feel to me forced however
Their stated distaste *capabilities* of cloud air, such as their ChatGPT builds, does feel to me forced however
https://www.reddit.com/r/LocalLLaMA/comments/1xntou1/lfm3omni2b_running_fully_offline_on_my_iphone_18/
https://www.reddit.com/r/LocalLLaMA/comments/1xntou1/lfm3omni2b_running_fully_offline_on_my_iphone_18/
What are you looking forward to in Qwen 4?
https://www.reddit.com/r/LocalLLaMA/comments/1xo3ikc/what_are_you_looking_forward_to_in_qwen_4/
#IA #AI #ML
What are you looking forward to in Qwen 4?
https://www.reddit.com/r/LocalLLaMA/comments/1xo3ikc/what_are_you_looking_forward_to_in_qwen_4/
#IA #AI #ML
1行目: Kimi-K3.1-Pro、オープンウェイト化
2〜3行目: Moonshot AI系の新モデルが重み公開。商用利用可能なライセンスとみられるが、詳細なベンチマークは本文未記載で不明。
🔗 https://www.reddit.com/r/LocalLLaMA/comments/1xnrhvb/kimik31pro_is_now_openweights/ #AI #人工知能 #LocalLLaMA
1行目: Kimi-K3.1-Pro、オープンウェイト化
2〜3行目: Moonshot AI系の新モデルが重み公開。商用利用可能なライセンスとみられるが、詳細なベンチマークは本文未記載で不明。
🔗 https://www.reddit.com/r/LocalLLaMA/comments/1xnrhvb/kimik31pro_is_now_openweights/ #AI #人工知能 #LocalLLaMA
Sur r/LocalLLaMA, un fil demande ce que chacun attend de Qwen 4, annoncé comme proche. L'auteur espère un 27B au cache KV plus efficace, pour qu'un contexte de 128k ne réclame plus environ 8 GiB de mémoire, et une déclinaison «…
#IA #OpenClaw
Sur r/LocalLLaMA, un fil demande ce que chacun attend de Qwen 4, annoncé comme proche. L'auteur espère un 27B au cache KV plus efficace, pour qu'un contexte de 128k ne réclame plus environ 8 GiB de mémoire, et une déclinaison «…
#IA #OpenClaw
Qwen3.8 27B Q4 on my low-end Laptop, and it became my main Model usage for coding
https://www.reddit.com/r/LocalLLaMA/comments/1xnzo38/qwen38_27b_q4_on_my_lowend_laptop_and_it_became/
#IA #AI #ML
Qwen3.8 27B Q4 on my low-end Laptop, and it became my main Model usage for coding
https://www.reddit.com/r/LocalLLaMA/comments/1xnzo38/qwen38_27b_q4_on_my_lowend_laptop_and_it_became/
#IA #AI #ML
ricursiveAI/Ripple-65B-Preview · Hugging Face
https://www.reddit.com/r/LocalLLaMA/comments/1xnx3cs/ricursiveairipple65bpreview_hugging_face/
#IA #AI #ML
ricursiveAI/Ripple-65B-Preview · Hugging Face
https://www.reddit.com/r/LocalLLaMA/comments/1xnx3cs/ricursiveairipple65bpreview_hugging_face/
#IA #AI #ML
Deepseek alone accounted for 53% of all (27 trillion) tokens on Openrouter yesterday. Open-weights labs totaling over 75% now
https://www.reddit.com/r/LocalLLaMA/comments/1xnz8ct/deepseek_alone_accounted_for_53_of_all_27/
#IA #AI #ML
Deepseek alone accounted for 53% of all (27 trillion) tokens on Openrouter yesterday. Open-weights labs totaling over 75% now
https://www.reddit.com/r/LocalLLaMA/comments/1xnz8ct/deepseek_alone_accounted_for_53_of_all_27/
#IA #AI #ML