Open LianaMikael opened 4 months ago
I would like to hold off merging this into main for a bit. I will work on this more (after the smaller fixes) and we can re-review.
I would like to hold off merging this into main for a bit. I will work on this more (after the smaller fixes) and we can re-review.
Any update by when the changes will be merged
I would like to hold off merging this into main for a bit. I will work on this more (after the smaller fixes) and we can re-review.
Any update by when the changes will be merged
We will work on merging these changes by the end of this week
This PR adds the implementations for sliced Phi and Llama models to make it easy to save and load sliced models. The models can be initialized with a given scheduler (or no scheduler for zero sparsity) and support
save_pretrained
andfrom_pretrained
methods like standard HF models.