jankais3r / LLaMA_MPS

Run LLaMA (and Stanford-Alpaca) inference on Apple Silicon GPUs.
GNU General Public License v3.0
583 stars 47 forks source link

Huggingface weights repo doesn't have params.json #11

Closed Maxhirez closed 1 year ago

Maxhirez commented 1 year ago

I pulled down llama-7b-hf and errored out with FileNotFoundError: [Errno 2] No such file or directory: 'models/llama-7b-hf/params.json' Is it still compatible or do I need to do the whole torrent thing? Can I bodge or bum a params.json file and avoid another 30 hour download?

Thanks

Maxhirez commented 1 year ago

copied this from another repo. Results gibberish. {"dim": 4096, "multiple_of": 256, "n_heads": 32, "n_layers": 32, "norm_eps": 1e-06}