Products & Apps

HPC-Ops × SGLang: Tencent Hunyuan open-sources high-performance Attention, Router GEMM and MoE operators

Original title:Blog HPC-Ops × SGLang: High-Performance Attention, Router GEMM, and MoE Kernels from Tencent Hunyuan HPC-Ops is an open-source operator library for LLM inference, deployed in Tencent's large-scale production serving. Its core operators, including Dynamic Attention and Fused MoE, play a critical role ... Tencent Hunyuan AI Infra and the SGLang Team

AI summary

Tencent Hunyuan's open-source operator library HPC-Ops has been integrated into the SGLang main branch, with its Dynamic Attention and Fused MoE reducing TPOT by up to 48.8% on the Hy3 model.

Key Takeaways

  • Tencent Hunyuan's open-source operator library HPC-Ops has been integrated into the SGLang main…
  • with its Dynamic Attention and Fused MoE reducing TPOT by up to 48.
  • 8% on the Hy3 model.

Quick Facts

Published
Updated
Source
LMSYS Blog
Category
Products & Apps
AI score
76
Read the original Read the full article at the original source
Why it matters

HPC-Ops 集成到 SGLang,带来生产验证的负载均衡 Attention 和精度感知 Router GEMM,实测 Hy3 TPOT 降幅最高 48.8%,为 MoE 低延迟服务提供了可直接使用的开源优化。

Related entities

Source & copyright

This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.

Original article · AIHOT entry

How to Cite

When citing this article, keep the title, date, and permalink, and credit Orange News as the source.

Orange News: HPC-Ops × SGLang: Tencent Hunyuan open-sources high-performance Attention, Router GEMM and MoE operators. August 7, 2026. https://new.nat6.net/en/news/cmsj8rfkl02ruroo5uvyqiqiq/

View all →