Model Releases

MolmoMotion: A Language-Guided 3D Motion Prediction Model

Original title:MolmoMotion: Language-guided 3D motion forecasting

AI summary

MolmoMotion is built on the Molmo 2 backbone and takes video frames, 3D point markers on objects and textual action instructions (such as "move and rotate the wooden bowl with fruit on the table") as input to predict the 3D trajectories of these points over the next few seconds. It offers two variants: the autoregressive MolmoMotion-AR predicts coordinates step by step, while the flow-matching MolmoMotion-FM handles multiple possible motions through continuous spatial transformations. The release also includes the MolmoMotion-1M dataset (3D point trajectories and action descriptions for 1.16 million videos) and the PointMotionBench benchmark (2,700 human-verified video clips). Model weights, dataset and benchmark are all open-source.

Key Takeaways

  • MolmoMotion is built on the Molmo 2 backbone and takes video frames,3D point markers on objects…
  • It offers two variants: the autoregressive MolmoMotion-AR predicts coordinates step by step,while…
  • The release also includes the MolmoMotion-1M dataset (3D point trajectories and action…
  • 16 million videos) and the PointMotionBench benchmark (2,700 human-verified video clips).
  • Model weights,dataset and benchmark are all open-source.

Quick Facts

Published
Updated
Source
Hugging Face 社区博客(混合发现)
Category
Model Releases
AI score
69
Read the original Read the full article at the original source
Why it matters

MolmoMotion把3D运动预测从模板化推到任意物体,百万级数据集和基准让研究门槛大降,做机器人和视频生成的值得认真看,但目前仍是研究阶段,离落地还有距离。

Source & copyright

This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.

Original article · AIHOT entry

How to Cite

When citing this article, keep the title, date, and permalink, and credit Orange News as the source.

Orange News: MolmoMotion: A Language-Guided 3D Motion Prediction Model. June 17, 2026. https://new.nat6.net/en/news/cmqi8qht206mtslf0a4q8mkrb/

View all →