save model meet problem

princeton-nlp / LLM-Shearing

[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning

https://arxiv.org/abs/2310.06694

MIT License

533 stars 39 forks source link

Open 18140663659 opened 6 months ago

18140663659 commented 6 months ago

when i use the prune.sh and save model, i meet this problem:

xiamengzhou commented 6 months ago

Hi, it mostly seems like a out of memory issue. Could you make sure that your cpu memory is sufficient for saving model weights?