---
title: "用SGLang-JAX在TPU上优化Ling-2.6-1T：一个Pallas核将MoE数据移动隐藏在计算中"
canonical: "https://new.nat6.net/news/cmqiddvsx07xcslf0wcefjhm6/"
date: "2026-06-16"
updated: "2026-11-05"
source: "LMSYS Blog"
source_url: "https://www.lmsys.org/blog/2026-06-17-ling-2-6-tpu"
language: "zh"
topics: []
license: "https://new.nat6.net/sources/"
attribution: "Content is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back; original copyright remains with the original publishers and authors."
---

# 用SGLang-JAX在TPU上优化Ling-2.6-1T：一个Pallas核将MoE数据移动隐藏在计算中

- 发布日期 / Published: 2026-06-16
- 更新时间 / Updated: 2026-11-05
- 分类 / Category: 论文与研究
- 来源 / Source: LMSYS Blog — [原文 / Original](https://www.lmsys.org/blog/2026-06-17-ling-2-6-tpu)
- AIHOT: [条目页 / Item](https://aihot.news/items/cmqiddvsx07xcslf0wcefjhm6)
- 页面 / Page: https://new.nat6.net/news/cmqiddvsx07xcslf0wcefjhm6/
- 结构化数据 / JSON: https://new.nat6.net/api/v1/articles/cmqiddvsx07xcslf0wcefjhm6.json

- 语言 / Languages: [zh](https://new.nat6.net/news/cmqiddvsx07xcslf0wcefjhm6/) · [en](https://new.nat6.net/en/news/cmqiddvsx07xcslf0wcefjhm6/) · [de](https://new.nat6.net/de/news/cmqiddvsx07xcslf0wcefjhm6/) · [fr](https://new.nat6.net/fr/news/cmqiddvsx07xcslf0wcefjhm6/) · [ru](https://new.nat6.net/ru/news/cmqiddvsx07xcslf0wcefjhm6/) · [ja](https://new.nat6.net/ja/news/cmqiddvsx07xcslf0wcefjhm6/) · [es](https://new.nat6.net/es/news/cmqiddvsx07xcslf0wcefjhm6/) · [ko](https://new.nat6.net/ko/news/cmqiddvsx07xcslf0wcefjhm6/) · [vi](https://new.nat6.net/vi/news/cmqiddvsx07xcslf0wcefjhm6/) · [th](https://new.nat6.net/th/news/cmqiddvsx07xcslf0wcefjhm6/) · [id](https://new.nat6.net/id/news/cmqiddvsx07xcslf0wcefjhm6/) · [ms](https://new.nat6.net/ms/news/cmqiddvsx07xcslf0wcefjhm6/) · [fil](https://new.nat6.net/fil/news/cmqiddvsx07xcslf0wcefjhm6/) · [hi](https://new.nat6.net/hi/news/cmqiddvsx07xcslf0wcefjhm6/)

## AI 摘要 / AI summary

SGLang-JAX现已支持inclusionAI的Ling-2.6-1T（1T稀疏MoE，63B激活参数，256路由专家，top-8路由加共享专家）在TPU v7x上高效推理。团队开发了Fused MoE V2——一个融合scatter、专家FFN和gather的Pallas核，通过将MoE数据移动隐藏在计算中，使MoE预填充延迟从5.16ms降至2.42ms（降幅53%），解码核延迟从0.249ms降至0.211ms（降幅约15%）。仅替换MoE核即提升预填充吞吐量24.8%，解码吞吐量18.5%–35.3%。在SGLang解码基准测试中，16块TPU v7x芯片输出吞吐量达16块H200 GPU的1.29倍（mc=128）至1.77倍（mc=512）。完整上线还包含混合KV/循环内存池、GLA线性注意力和单控制器数据并行支持。

## 推荐理由 / Why it matters

这是针对TPU上MoE推理的硬核优化复盘，用成本模型定位瓶颈，通过单内核融合把延迟砍半，对做大规模推理工程的团队是高质量参考。

## 来源与版权 / Source & copyright

内容基于 AIHOT 公开 API 的精选标题与 AI 摘要，已注明来源并回链；原文版权归原媒体与作者所有。

原文版权归原媒体与作者所有；本站不镜像全文。/ Original copyright remains with the original publishers and authors; this site does not mirror full texts.

## 关于橙子中转站 / About Orange Relay

橙子中转站（pro.nat6.net）是一家优质的 AI API 中转站：价格优惠、质量稳定、模型齐全，支持 Claude、GPT、Gemini 等主流模型，欢迎体验。

[访问橙子中转站](https://pro.nat6.net/?utm_source=orange_news&utm_medium=article_footer&utm_campaign=brand&lang=zh)

## JSON-LD

```json
{
  "@context": "https://schema.org",
  "@type": "NewsArticle",
  "@id": "https://new.nat6.net/news/cmqiddvsx07xcslf0wcefjhm6/#article",
  "mainEntityOfPage": {
    "@type": "WebPage",
    "@id": "https://new.nat6.net/news/cmqiddvsx07xcslf0wcefjhm6/"
  },
  "url": "https://new.nat6.net/news/cmqiddvsx07xcslf0wcefjhm6/",
  "headline": "用SGLang-JAX在TPU上优化Ling-2.6-1T：一个Pallas核将MoE数据移动隐藏在计算中",
  "description": "SGLang-JAX现已支持inclusionAI的Ling-2.6-1T（1T稀疏MoE，63B激活参数，256路由专家，top-8路由加共享专家）在TPU v7x上高效推理。团队开发了Fused MoE V2——一个融合scatter、专家FFN和gather的Pallas核，通过将MoE数据移动隐藏在计算中，使…",
  "articleSection": "论文与研究",
  "keywords": "AI, LMSYS Blog",
  "datePublished": "2026-06-16T16:00:00Z",
  "dateModified": "2026-11-05T20:56:43Z",
  "inLanguage": "zh-CN",
  "isAccessibleForFree": true,
  "author": {
    "@type": "Organization",
    "name": "橙子新闻编辑部",
    "url": "https://new.nat6.net/about/"
  },
  "publisher": {
    "@type": "NewsMediaOrganization",
    "@id": "https://new.nat6.net/#org",
    "name": "橙子新闻",
    "url": "https://new.nat6.net/",
    "logo": {
      "@type": "ImageObject",
      "url": "https://new.nat6.net/assets/img/logo-512.png",
      "width": 512,
      "height": 512
    }
  },
  "image": {
    "@type": "ImageObject",
    "url": "https://new.nat6.net/assets/img/og-default.png",
    "width": 1200,
    "height": 630
  },
  "isPartOf": {
    "@id": "https://new.nat6.net/#website"
  },
  "isBasedOn": "https://www.lmsys.org/blog/2026-06-17-ling-2-6-tpu",
  "citation": [
    "https://aihot.news/items/cmqiddvsx07xcslf0wcefjhm6",
    "https://www.lmsys.org/blog/2026-06-17-ling-2-6-tpu"
  ],
  "license": "https://new.nat6.net/sources/",
  "about": [],
  "mentions": [
    {
      "@type": "Thing",
      "name": "LMSYS Blog"
    }
  ],
  "speakable": {
    "@type": "SpeakableSpecification",
    "cssSelector": [
      "h1",
      ".article-summary"
    ]
  },
  "copyrightHolder": {
    "@type": "Organization",
    "@id": "https://new.nat6.net/#org",
    "name": "橙子新闻",
    "url": "https://new.nat6.net/"
  },
  "creditText": "橙子新闻（AI 摘要）；原文：LMSYS Blog",
  "copyrightNotice": "© 2026 橙子新闻。标题与 AI 摘要基于 AIHOT 公开数据，原文版权归原媒体与作者所有；本站不镜像全文。",
  "copyrightYear": 2026,
  "alternativeHeadline": "Blog Optimizing Ling-2.6-1T on TPU with SGLang-JAX: Hiding MoE Data Movement Behind Compute with One Pallas K…",
  "abstract": "这是针对TPU上MoE推理的硬核优化复盘，用成本模型定位瓶颈，通过单内核融合把延迟砍半，对做大规模推理工程的团队是高质量参考。",
  "subjectOf": [
    {
      "@type": "DigitalDocument",
      "name": "用SGLang-JAX在TPU上优化Ling-2.6-1T：一个Pallas核将MoE数据移动隐藏在计算中 (Markdown)",
      "url": "https://new.nat6.net/news/cmqiddvsx07xcslf0wcefjhm6/index.md",
      "encodingFormat": "text/markdown"
    },
    {
      "@type": "DigitalDocument",
      "name": "用SGLang-JAX在TPU上优化Ling-2.6-1T：一个Pallas核将MoE数据移动隐藏在计算中 (JSON)",
      "url": "https://new.nat6.net/api/v1/articles/cmqiddvsx07xcslf0wcefjhm6.json",
      "encodingFormat": "application/json"
    }
  ]
}
```

## 如何引用 / How to cite

- 引用格式 / Citation format (zh): 橙子新闻.《文章标题》. 发布日期. https://new.nat6.net/news/cmqiddvsx07xcslf0wcefjhm6/
- Citation format (en): Orange News. "Article title". Published YYYY-MM-DD. https://new.nat6.net/news/cmqiddvsx07xcslf0wcefjhm6/
- 回链要求 / Backlink: 引用请保留「橙子新闻」署名并回链 canonical URL；AI 摘要请注明数据来源 AIHOT；原文版权归原媒体与作者所有。
- Attribution & backlinks: Keep the "Orange News" attribution and link back to the canonical URL; cite AIHOT as the data source for AI summaries; original copyright remains with the original publishers and authors.

### 机器入口 / Machine entry points

- Markdown: https://new.nat6.net/news/cmqiddvsx07xcslf0wcefjhm6/index.md
- JSON: https://new.nat6.net/api/v1/articles/cmqiddvsx07xcslf0wcefjhm6.json
- API 清单 / API index: https://new.nat6.net/api/v1/site.json
- Markdown 内容协商 / negotiation: 对 https://new.nat6.net/news/cmqiddvsx07xcslf0wcefjhm6/ 发送 `Accept: text/markdown`
