PEFT / research notes

RESEARCH NOTES / OCTOBER 2026

How different are
parameter-efficient
fine-tuning methods, really?

Yikuan Li · Pinyan Lu · Fanghui Liu

Paper ↗Code ↗6 minute read · interactive figures

01 /

LoRA
OFT

DoRA

PiSSA / MiLoRA

HRA

FIG. 1A

FIG. 1B

02 /

FIG. 2

03 /

FIG. 3

04 /

@misc{li2026parameterefficientfinetuningmethodsreally,
      title={Are Parameter-Efficient Fine-tuning Methods Really Different?},
      author={Yikuan Li and Pinyan Lu and Fanghui Liu},
      year={2026},
      eprint={2610.09122},
      archivePrefix={arXiv},
      primaryClass={cs.LG},
      url={https://arxiv.org/abs/2610.09122},
}