Papers & Research

Thinking Machines Lab releases LoRA Without Regret research

Original title:LoRA Without Regret

AI summary

Thinking Machines Lab published research systematically characterizing the "low-regret regime" in which LoRA matches full fine-tuning (FullFT), covering most post-training scenarios. The core conclusion: when LoRA is applied to all weight layers, especially MLP/MoE layers, and capacity is unconstrained, supervised fine-tuning with LoRA matches FullFT in sample efficiency and final performance; in RL settings it matches fully even at rank=1.

Key Takeaways

  • Thinking Machines Lab published research systematically characterizing the "low-regret regime" in…
  • The core conclusion: when LoRA is applied to all weight layers,especially MLP/MoE layers,and…
  • in RL settings it matches fully even at rank=1.

Quick Facts

Published
Updated
Source
Thinking Machines Lab:官方博客
Category
Papers & Research
AI score
69
Read the original Read the full article at the original source
Why it matters

文章通过系统实验给出了 LoRA 与全量微调表现相当的两个条件,读者可据此判断自己的微调场景能否改用 LoRA。

Source & copyright

This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.

Original article · AIHOT entry

How to Cite

When citing this article, keep the title, date, and permalink, and credit Orange News as the source.

Orange News: Thinking Machines Lab releases LoRA Without Regret research. September 29, 2025. https://new.nat6.net/en/news/cmq75sy1q0007sl5wq9kxp601/

View all →