Error while generating wizardlm weights: missing utils file in train_freeform.py

[gabriead]

Hi guys,

I followed the instructions to generate the weights from source. There is no file named "utils" imported in line 25 in train_freeform.py. Please provide that in the repo.

[NamburiSrinath]

Yes, how can we recover the original weights? Is there any update on this issue yet

I changed the following line in weight_diff_wizard.py

from train import smart_tokenizer_and_embedding_resize to from train_freeform import smart_tokenizer_and_embedding_resize

and then I am facing this issue.

[yatesdr]

You have to install lm-sys/Fastchat and rename train_freeform.py to train.py. That should get it working if you're otherwise capable.

I managed to get a merge done today with the following:

using python-3.10 venv git clone im-sys/Fastchat pip install . in Fastchat directory rename train_freeform.py to train.py install other missing python deps per errors, there were quite a few Make sure you have at least 288GB of RAM + Swap available. Merging deltas per the commands provided, more or less: python weight_diff_wizard.py recover --path_raw ../../llama-30b/ --path_diff ../../WizardLM-30B-V1.0/ --path_tuned ../../Wizard-LM-30b-Merged/

[ZhengYangCS]

utils.py

import json def jload(path):     fr = open(path, 'r')     d = json.load(fr)     return d