Records found and checked by machines, not reviewed by an editor · What this means →

Claim · 2021-06-17 · publication · Stated in source · Supported

The paper proposes Low-Rank Adaptation (LoRA), which freezes pre-trained model weights and injects trainable rank decomposition matrices into each Transformer layer, and states that this greatly reduces the number of trainable parameters for downstream tasks.

One recorded claim. The claim panel gives its qualification, the source passages with their place in each source, and how it was checked.

What it connects

LoRA: Low-Rank Adaptation of Large Language Models → states its contribution → The paper proposes Low-Rank Adaptation (LoRA), which freezes pre-trained model weights and injects trainable rank decomposition matrices into each Transformer layer, and states that this greatly reduces the number of trainable parameters for downstream tasks.

Where it appears

No collection page holds this claim. It is listed with its records in the explorer.