From 'next-word prediction' to 'world modeling': the second paradigm of AI pretraining
Original title:http://x.com/i/article/2018744045779238912
AI summary
The author argues that AI pretraining is undergoing a fundamental paradigm shift from 'next-word prediction' to 'world modeling.' The core of a world model is predicting the next sequence of physical states given an action; it is essentially a learnable physical simulator and places vision first. In contrast, current mainstream vision-language models are language-first, with vision as a secondary input. In biological intelligence, visual processing dominates cortical computation and is a high-bandwidth channel connecting the brain, action, and the physical world. Citing apes as an example, the author argues that powerful physical intelligence can exist independently of advanced language. He predicts that in 2026 large world models will lay a real foundation for robotics and multimodal AI, while massive visual data from platforms such as YouTube will far exceed text in scale and drive this new paradigm.
Key Takeaways
- The author argues that AI pretraining is undergoing a fundamental paradigm shift from 'next-word…
- ' The core of a world model is predicting the next sequence of physical states given an action
- it is essentially a learnable physical simulator and places vision first.
- In contrast,current mainstream vision-language models are language-first,with vision as a…
- In biological intelligence,visual processing dominates cortical computation and is a…
Quick Facts
- Published
- Updated
- Source
- X:Jim Fan (@DrJimFan)
- Category
- Opinion
- AI score
- 72
Jim Fan 把世界模型定义为第二次预训练范式转移,核心论点是视觉优先而非语言优先,这个框架对做机器人和多模态的人是真正的路线判断,不是又一篇水文。
Source & copyright
This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.
How to Cite
When citing this article, keep the title, date, and permalink, and credit Orange News as the source.
Orange News: From 'next-word prediction' to 'world modeling': the second paradigm of AI pretraining. February 4, 2026. https://new.nat6.net/en/news/cmo22oj0y010dslba9u0c1ul1/