Unsloth releases MiniMax-M3.1-Flash quantized GGUF, 2-bit version runs locally on 150GB of memory
Original title:MiniMax-M3.1-Flash can now run locally!
AI summary
Unsloth released quantized GGUF versions of MiniMax-M3.1-Flash; the 2-bit version retains 91.5% top-1 accuracy while shrinking size by 45% and can run locally on 150GB of memory, the 1-bit version reaches about 89.9%, and 4-bit UD-Q4_K_XL reaches 98.0%. The author called it one of the strongest open-source models of its size and provided Hugging Face weight links and a local running guide.
Key Takeaways
- Unsloth released quantized GGUF versions of MiniMax-M3.
- 1-Flash
- the 2-bit version retains 91.
- 5% top-1 accuracy while shrinking size by 45% and can run locally on 150GB of memory,the 1-bit…
- 9%,and 4-bit UD-Q4_K_XL reaches 98.
Quick Facts
- Published
- Updated
- Source
- X:Unsloth (@UnslothAI)
- Category
- Products & Apps
- AI score
- 70
原文给出自建 GGUF 量化在保留精度与压缩体积间的实测数据,以及各档位所需内存,读者可据此判断能否本地部署。
Related entities
Source & copyright
This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.
How to Cite
When citing this article, keep the title, date, and permalink, and credit Orange News as the source.
Orange News: Unsloth releases MiniMax-M3.1-Flash quantized GGUF, 2-bit version runs locally on 150GB of memory. October 26, 2026. https://new.nat6.net/en/news/pkw262qrrom8w7qv6lq7nquxh/