ModelBest explains how lookahead expert scheduling (LES) runs a 35B MoE losslessly in real time on phones
Original title:面壁智能前瞻专家调度(LES):让 35B MoE 在手机上实时无损运行的推理技术
AI summary
The ModelBest MiniCPM-V team detailed the lookahead expert scheduling (LES) technique behind on-device MiniCPM-V 4.7, saying it is the first to run a 35B-A3B-scale MoE losslessly in real time on devices, with decoding above 20 tokens/s measured on an iPhone 18 Pro Max.
Key Takeaways
- The ModelBest MiniCPM-V team detailed the lookahead expert scheduling (LES) technique behind…
- saying it is the first to run a 35B-A3B-scale MoE losslessly in real time on devices
- with decoding above 20 tokens/s measured on an iPhone 18 Pro Max.
Quick Facts
- Published
- Updated
- Source
- 公众号:面壁智能(MiniCPM)
- Category
- Tutorials & Tips
- AI score
- 68
原文拆解了 LES 在调度、存储、计算三层的具体设计,并给出消融数据,方法可迁移到其他 MoE 模型的端侧部署。
Topics
Source & copyright
This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.
How to Cite
When citing this article, keep the title, date, and permalink, and credit Orange News as the source.
Orange News: ModelBest explains how lookahead expert scheduling (LES) runs a 35B MoE losslessly in real time on phones. October 20, 2026. https://new.nat6.net/en/news/m2ylwtzb8x49c32spfl1wplqz/