New Method PiSSA Significantly Enhances Fine-Tuning Effects
As the parameter count of large models continues to grow, the cost of fine-tuning the entire model has become increasingly unacceptable. To address this, a research team from Peking University proposed a parameter-efficient fine-tuning method called PiSSA, which surpasses the fine-tuning effects of the widely used LoRA on mainstream datasets. Paper Title: PiSSA: Principal Singular … Read more