search

0nutation / SpeechGPT

SpeechGPT Series: Speech Large Language Models
https://0nutation.github.io/SpeechGPT.github.io/
Apache License 2.0
1.04k stars 64 forks source link

Is the backbone LLM 7B or 13B LLaMA? #10

Closed rperi closed 9 months ago

rperi commented 9 months ago

The paper mentions the use of 13B LLaMA backend, however the repository uses 7B model. Which is the correct one? Am I missing something?

0nutation commented 9 months ago

In our paper, we used LLaMA 13B, but due to resource constraints and for easier deployment, we retrained on the 7B LLaMA model and open source this 7B version. If we have sufficient computing resources in the future, we will retrain a better 13B version and release it as open source.

rperi commented 9 months ago

Thanks for the clarification!