ngrok.com/blog/quantiz...
ngrok.com/blog/quantiz...
bad girls go into the quantization chamber
bad girls go into the quantization chamber
blog: prismml.com/news/bonsai-...
webgpu (browser-native!) demo: huggingface.co/spaces/webml...
blog: prismml.com/news/bonsai-...
webgpu (browser-native!) demo: huggingface.co/spaces/webml...
⭐ 3,886 (+22)
🗒 Python
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorR...
⭐ 3,886 (+22)
🗒 Python
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorR...