Papers & Research

Text-conditioned JEPA for learning semantically rich visual representations

Original title:Text-Conditional JEPA for Learning Semantically Rich Visual Representations

AI summary

Researchers propose Text-Conditioned Joint Embedding Predictive Architecture (TC-JEPA), which introduces image caption text as conditioning information to reduce visual uncertainty in masked feature prediction. The method uses a fine-grained text conditioner that computes sparse cross-attention over input text tokens to modulate predicted image patch features. Compared with I-JEPA based on masked feature prediction, TC-JEPA can learn semantically richer visual representations, addressing the insufficient semantic learning of the original method caused by visual uncertainty.

Key Takeaways

  • Researchers propose Text-Conditioned Joint Embedding Predictive Architecture (TC-JEPA),which…
  • The method uses a fine-grained text conditioner that computes sparse cross-attention over input…
  • Compared with I-JEPA based on masked feature prediction,TC-JEPA can learn semantically richer…

Quick Facts

Published
Updated
Source
Apple Machine Learning Research(RSS)
Category
Papers & Research
AI score
69
Read the original Read the full article at the original source
Why it matters

Apple 这篇 TC-JEPA 把文本融入自监督视觉预训练,用稀疏交叉注意力减少预测不确定性,对多模态表征学习是个不错的思路补充,做视觉模型的值得一看。

Source & copyright

This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.

Original article · AIHOT entry

How to Cite

When citing this article, keep the title, date, and permalink, and credit Orange News as the source.

Orange News: Text-conditioned JEPA for learning semantically rich visual representations. May 7, 2026. https://new.nat6.net/en/news/cmovtn194006zslcxkg4a1yti/

View all →