Model Releases

Ant Group's inclusionAI open-sources Ling-3.0 series efficient language base models

Original title:inclusionAI/Ling-3.0-flash-base

AI summary

Ant Group's inclusionAI open-sourced the Ling-3.0 series language base models, using a highly sparse (1/64) MoE architecture with 512 routed experts. Each token activates only 8 routed experts and 1 shared expert, with only 5.1B activated parameters (Non-emb).

Key Takeaways

  • Ant Group's inclusionAI open-sourced the Ling-3.
  • 0 series language base models,using a highly sparse (1/64) MoE architecture with 512 routed experts.
  • Each token activates only 8 routed experts and 1 shared expert,with only 5.
  • 1B activated parameters (Non-emb).

Quick Facts

Published
Updated
Source
蚂蚁 inclusionAI:HuggingFace 新模型
Category
Model Releases
AI score
64
Read the original Read the full article at the original source
Why it matters

WSM 合并替代学习率衰减,让持续预训练和动态数据扩展不必为每种衰减策略重跑训练,降低实验成本。

Source & copyright

This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.

Original article · AIHOT entry

How to Cite

When citing this article, keep the title, date, and permalink, and credit Orange News as the source.

Orange News: Ant Group's inclusionAI open-sources Ling-3.0 series efficient language base models. August 11, 2026. https://new.nat6.net/en/news/cmt0aa8b416yyrodpws2xobnz/

View all →