Closed Ayushk4 closed 1 year ago
Since GPT-NeoX support (Pythia based Open Assistant models) has been confirmed by #24 , we can port other chat-models.
Instructions:
python3 cformers/cpp/converters/convert_gptneox_to_ggml.py <MODEL_CARD> <SAVE_PATH> 1
cd cformers/cpp && make
./quantize SAVE_PATH QUANTIZE_SAVE_PATH 2
cformers/interface.py
I will help with that today.
I`m on the finall stage, uploading to the HF.
https://huggingface.co/Black-Engineer/OpenChatKit_q4/tree/main
Thanks.
Thanks, a lot!
Since GPT-NeoX support (Pythia based Open Assistant models) has been confirmed by #24 , we can port other chat-models.
Instructions:
python3 cformers/cpp/converters/convert_gptneox_to_ggml.py <MODEL_CARD> <SAVE_PATH> 1
cd cformers/cpp && make
,./quantize SAVE_PATH QUANTIZE_SAVE_PATH 2
cformers/interface.py
with path and update README