Model Releases

Xiaomi open-sources controllable video Foley sound generation model ControlFoley, letting sound follow your intent

AI summary

Xiaomi's large model application team released ControlFoley, an open-source controllable video Foley sound generation model aimed at solving controllability challenges in creation. The model uniformly supports three tasks: text-guided video dubbing, text-controlled video dubbing, and reference-audio-controlled video dubbing. ControlFoley achieves open-source SOTA on multiple benchmarks including VGGSound-Test, with its code, model weights and online demo all publicly available.

Key Takeaways

  • Xiaomi's large model application team released ControlFoley,an open-source controllable video…
  • The model uniformly supports three tasks: text-guided video dubbing,text-controlled video…
  • ControlFoley achieves open-source SOTA on multiple benchmarks including VGGSound-Test,with its…

Quick Facts

Published
Updated
Source
IT之家·人工智能
Category
Model Releases
AI score
74
Read the original Read the full article at the original source
Why it matters

小米开源的 ControlFoley 把视频音效生成从“看画面配声音”推进到“按意图来”,开源 SOTA 且直接提供 Skill,做视频创作的可以上手试试。

Source & copyright

This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.

Original article · AIHOT entry

How to Cite

When citing this article, keep the title, date, and permalink, and credit Orange News as the source.

Orange News: Xiaomi open-sources controllable video Foley sound generation model ControlFoley, letting sound follow your intent. May 29, 2026. https://new.nat6.net/en/news/cmpqppxpf075oslno4jxz0h8b/

View all →