Tutorials & Tips

ModelBest explains how lookahead expert scheduling (LES) runs a 35B MoE losslessly in real time on phones

Original title:面壁智能前瞻专家调度(LES):让 35B MoE 在手机上实时无损运行的推理技术

AI summary

The ModelBest MiniCPM-V team detailed the lookahead expert scheduling (LES) technique behind on-device MiniCPM-V 4.7, saying it is the first to run a 35B-A3B-scale MoE losslessly in real time on devices, with decoding above 20 tokens/s measured on an iPhone 18 Pro Max.

Key Takeaways

  • The ModelBest MiniCPM-V team detailed the lookahead expert scheduling (LES) technique behind…
  • saying it is the first to run a 35B-A3B-scale MoE losslessly in real time on devices
  • with decoding above 20 tokens/s measured on an iPhone 18 Pro Max.

Quick Facts

Published
Updated
Source
公众号:面壁智能(MiniCPM)
Category
Tutorials & Tips
Topic
Open-Source EcosystemDeployment EngineeringTutorials & Practice
AI score
68
Read the original Read the full article at the original source
Why it matters

原文拆解了 LES 在调度、存储、计算三层的具体设计,并给出消融数据,方法可迁移到其他 MoE 模型的端侧部署。

Topics

Source & copyright

This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.

Original article · AIHOT entry

How to Cite

When citing this article, keep the title, date, and permalink, and credit Orange News as the source.

Orange News: ModelBest explains how lookahead expert scheduling (LES) runs a 35B MoE losslessly in real time on phones. October 20, 2026. https://new.nat6.net/en/news/m2ylwtzb8x49c32spfl1wplqz/

View all →