New arXiv work proposes choosing where to apply parameter-efficient fine-tuning across a Transformer, using empirical Fisher scores to guide layer selection for better capability retention. It avoids extra data replay or…

#PEFT #LLMs #MachineLearning
https://arxiv.org/abs/2610.11620