HPC-Ops × SGLang: Tencent Hunyuan open-sources high-performance Attention, Router GEMM and MoE operators
Original title:Blog HPC-Ops × SGLang: High-Performance Attention, Router GEMM, and MoE Kernels from Tencent Hunyuan HPC-Ops is an open-source operator library for LLM inference, deployed in Tencent's large-scale production serving. Its core operators, including Dynamic Attention and Fused MoE, play a critical role ... Tencent Hunyuan AI Infra and the SGLang Team
AI summary
Tencent Hunyuan's open-source operator library HPC-Ops has been integrated into the SGLang main branch, with its Dynamic Attention and Fused MoE reducing TPOT by up to 48.8% on the Hy3 model.
Key Takeaways
- Tencent Hunyuan's open-source operator library HPC-Ops has been integrated into the SGLang main…
- with its Dynamic Attention and Fused MoE reducing TPOT by up to 48.
- 8% on the Hy3 model.
Quick Facts
- Published
- Updated
- Source
- LMSYS Blog
- Category
- Products & Apps
- AI score
- 76
HPC-Ops 集成到 SGLang,带来生产验证的负载均衡 Attention 和精度感知 Router GEMM,实测 Hy3 TPOT 降幅最高 48.8%,为 MoE 低延迟服务提供了可直接使用的开源优化。
Related entities
Source & copyright
This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.
How to Cite
When citing this article, keep the title, date, and permalink, and credit Orange News as the source.
Orange News: HPC-Ops × SGLang: Tencent Hunyuan open-sources high-performance Attention, Router GEMM and MoE operators. August 7, 2026. https://new.nat6.net/en/news/cmsj8rfkl02ruroo5uvyqiqiq/