Products & Apps

Tencent Hunyuan quantizes Hy3 flagship model to 1-bit and 4-bit, enabling single-card deployment

Original title:极致量化,近三千亿参数 Hy3 单卡即可部署

AI summary

Tencent Hunyuan has quantized the weights of its 295B-parameter Hy3 flagship model to 1-bit and 4-bit and packaged them as GGUF. With the llama.cpp ecosystem, the model that originally required a multi-card cluster can now run on at least one 96GB inference GPU. The 1-bit version compresses weights from 598GB to 85.5GiB, while the 4-bit version is 169.9GiB and can run on two GPUs. The quantized versions are close to full performance on long-document understanding, agent and coding tasks, and decoding speed improves by about 50%-60% with MTP enabled.

Key Takeaways

  • Tencent Hunyuan has quantized the weights of its 295B-parameter Hy3 flagship model to 1-bit and…
  • With the llama.
  • cpp ecosystem,the model that originally required a multi-card cluster can now run on at least one…
  • The 1-bit version compresses weights from 598GB to 85.
  • 5GiB,while the 4-bit version is 169.

Quick Facts

Published
Updated
Source
公众号:腾讯混元
Category
Products & Apps
AI score
78
Read the original Read the full article at the original source
Why it matters

将 295B 旗舰模型量化至单卡部署,1bit 版本在长文理解上仍接近满血,且提供 MTP 加速,改变了本地运行大模型的门槛与成本考量。

Related entities

Source & copyright

This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.

Original article · AIHOT entry

How to Cite

When citing this article, keep the title, date, and permalink, and credit Orange News as the source.

Orange News: Tencent Hunyuan quantizes Hy3 flagship model to 1-bit and 4-bit, enabling single-card deployment. July 14, 2026. https://new.nat6.net/en/news/cmsdu2uhb013orofz5u7hfmv2/

View all →