Products & Apps

Unsloth releases MiniMax-M3.1-Flash quantized GGUF, 2-bit version runs locally on 150GB of memory

Original title:MiniMax-M3.1-Flash can now run locally!

AI summary

Unsloth released quantized GGUF versions of MiniMax-M3.1-Flash; the 2-bit version retains 91.5% top-1 accuracy while shrinking size by 45% and can run locally on 150GB of memory, the 1-bit version reaches about 89.9%, and 4-bit UD-Q4_K_XL reaches 98.0%. The author called it one of the strongest open-source models of its size and provided Hugging Face weight links and a local running guide.

Key Takeaways

  • Unsloth released quantized GGUF versions of MiniMax-M3.
  • 1-Flash
  • the 2-bit version retains 91.
  • 5% top-1 accuracy while shrinking size by 45% and can run locally on 150GB of memory,the 1-bit…
  • 9%,and 4-bit UD-Q4_K_XL reaches 98.

Quick Facts

Published
Updated
Source
X:Unsloth (@UnslothAI)
Category
Products & Apps
Topic
Product UpdatesOpen-Source Ecosystem
AI score
70
Read the original Read the full article at the original source
Why it matters

原文给出自建 GGUF 量化在保留精度与压缩体积间的实测数据,以及各档位所需内存,读者可据此判断能否本地部署。

Topics

Related entities

Source & copyright

This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.

Original article · AIHOT entry

How to Cite

When citing this article, keep the title, date, and permalink, and credit Orange News as the source.

Orange News: Unsloth releases MiniMax-M3.1-Flash quantized GGUF, 2-bit version runs locally on 150GB of memory. October 26, 2026. https://new.nat6.net/en/news/pkw262qrrom8w7qv6lq7nquxh/

View all →