search

ggerganov / llama.cpp

LLM inference in C/C++
MIT License
67.64k stars 9.71k forks source link

Pythia Support? #742

Closed lodorg closed 5 months ago

lodorg commented 1 year ago

Hi, I've found out that Pythia (from EleutherAI) is better that Cerebras GPT in terms of evaluation results. Pythia is basically a LLM that based on GPT NeoX architecture but it's parameters ranging from 70M, 160M, 410M, 1B, 1.4B, 2.8B, 6.9B to 13B. Pythia itself is available in GitHub repository "EleutherAI/pythia" and Huggingface Models under the same name.

Does this project support Pythia based models? If no, any plans on supporting them afterwards? I appreciate the implementation of Pythia in this project. Thank you very much before.

fakerybakery commented 1 year ago

Hi, is there any update on this @ggerganov?

github-actions[bot] commented 7 months ago

This issue was closed because it has been inactive for 14 days since being marked as stale.

fakerybakery commented 7 months ago

Can we please get this reopened @ggerganov