Stability-AI / StableLM

StableLM: Stability AI Language Models
Apache License 2.0
15.85k stars 1.04k forks source link

Source code for the model #56

Closed vivek-kokotree closed 1 year ago

vivek-kokotree commented 1 year ago

Hi,

Just curious: will Stability release the source code that was used to build the model? I know without weights/training set that source won't be of much use, but I would still like to see the source code so that we know what's under the hood.

Thanks,

Vivek

vancoykendall commented 1 year ago

Based on their config files and the fact they use the GPT-NeoX architecture they probably used their fork of EleutherAI's gpt-neox repo.