search

SafeAILab / EAGLE

Official Implementation of EAGLE-1 (ICML'24) and EAGLE-2 (EMNLP'24)
https://arxiv.org/pdf/2406.16858
Apache License 2.0
780 stars 79 forks source link

No pytorch.bin is generated after training is done #21

Closed tjtanaa closed 8 months ago

tjtanaa commented 8 months ago

I have rerun the whole training pipeline for the vicuna 7b model. The training ended successfully. However, there is no pytorch.bin is generated. May I know why?

The following folders and files are what I get. Folders:

state_0  state_10  state_12  state_15  state_17  state_2   state_3  state_6  state_8
state_1  state_11  state_13  state_16  state_18  state_20  state_5  state_7

Files:

config.json  model_1.safetensors  model.safetensors  optimizer.bin  random_states_0.pkl  scheduler.bin
Liyuhui-12 commented 8 months ago

The specific filename depends on the code you used to save the weights. Based on your screenshot, it seems that the EAGLE weights were saved as model.safetensors. You could try loading the weights from model.safetensors.

tjtanaa commented 8 months ago

Thank you very much. Loading from safetensors work. However, I need to modify the scripts.