Closed pdh930105 closed 1 month ago
Thank you for sharing the code for this research.
I couldn't find the code and config file related to layer sharing (-LS) in the model implementation section.
Will this part be updated in the future?
@pdh930105 If you investigate the code for LlamaForCausalLM/LlamaModel you will be able find both the code for layer sharing and embedding sharing.
@Atharva-Phatak thank you for the info!
Thank you for sharing the code for this research.
I couldn't find the code and config file related to layer sharing (-LS) in the model implementation section.
Will this part be updated in the future?