Closed tanshuai0219 closed 5 months ago
Hi~ Do you have a try to use a residual connection between t5 embedding and adapter output?
We haven't made this attempt. But I believe it's a great idea and worth a try!
Thanks~
Hi~ Do you have a try to use a residual connection between t5 embedding and adapter output?