search

OpenMatch / TASTE

[CIKM 2023] This is the code repo for our CIKM‘23 paper "Text Matching Improves Sequential Recommendation by Reducing Popularity Biases".
MIT License
34 stars 4 forks source link

LoRA with OpenDelta #11

Closed eric1anderson closed 8 months ago

eric1anderson commented 8 months ago

Hi,

I am interested in applying LoRA to this model architecture. I see OpenDelta mentioned in the code and I am able to define a parameter efficient method as an argument in the train.sh scripts. Though OpenDelta appears to be having trouble adding LoRA to custom TASTEModel class. Have you explored adding LoRA to TASTE with any success?

Thank you!

mssssss123 commented 8 months ago

Hi, this code does not use OpenDelta, so I have not tried it.

eric1anderson commented 8 months ago

Okay, thank you!