Open atorsvn opened 1 year ago
Pythia (and more specifically gpt4all or dolly) use the GPT-NeoX architecture. Also using GPT-NeoX is stablelm, which recently had an example added: https://github.com/ggerganov/ggml/tree/master/examples/stablelm
If you download the gpt4all pythia model, the stablelm example might work to convert and run it; however I don't know if it actually will.
How would I convert this into the ggml format?
https://huggingface.co/andreaskoepf/pythia-2.8b-gpt4all-pretrain/tree/main