Viewing a single comment thread. View all comments

JClub t1_j9j5cv4 wrote

Sorry, but why do we need another package? Can't you build on top of https://github.com/huggingface/peft ?

0

cccntu OP t1_j9jz6ov wrote

This project started out as me exploring if PyTorch parametrizations could be used to do LoRA, and it turned out perfect for this task! And I simply wanted to share that.
I think it would be interesting to see it integrated into PEFT, too. Although they already have their own LoRA implementation there.

1