ckpt_0001 · saved 2025
LoRA Users Beware: A Few Spurious Tokens Can Manipulate Your Finetuned Model
Marcel Mateos Salles, Praney Goyal, Pradyut Sekhsaria, Hai Huang, Randall Balestriero
Shows that a handful of spurious tokens in finetuning data is enough to steer the behavior of LoRA-finetuned language models.