search

ggerganov / ggml

Tensor library for machine learning
MIT License
11.26k stars 1.05k forks source link

Convert gpt4all pythia #90

Open atorsvn opened 1 year ago

atorsvn commented 1 year ago

How would I convert this into the ggml format?

https://huggingface.co/andreaskoepf/pythia-2.8b-gpt4all-pretrain/tree/main

leroycep commented 1 year ago

Pythia (and more specifically gpt4all or dolly) use the GPT-NeoX architecture. Also using GPT-NeoX is stablelm, which recently had an example added: https://github.com/ggerganov/ggml/tree/master/examples/stablelm

If you download the gpt4all pythia model, the stablelm example might work to convert and run it; however I don't know if it actually will.