Closed vince62s closed 10 months ago
I think we should also include the register_buffer in the modules here:
https://github.com/Cornell-RelaxML/quip-sharp/blob/main/model/llama_nofuse.py#L258-L260
Oh I forgot to update the nofuse version. I'll fix that at some point but we didn't release any of the nofuse models and those buffers aren't actually used.
I think we should also include the register_buffer in the modules here:
https://github.com/Cornell-RelaxML/quip-sharp/blob/main/model/llama_nofuse.py#L258-L260