openlm-research / open_llama

OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
Apache License 2.0
7.36k stars 374 forks source link

Do you need help with this project? #90

Open snichols opened 1 year ago

snichols commented 1 year ago

I've been tracking and working with Open Llama for months. I picked it as my foundational model for other work for a few reasons:

  1. Permissive license without Meta's draconian acceptable use policy.
  2. More flexible model sizes (3B).
  3. Good baseline performance.

I'm getting a bit concerned that this project may be abandoned, though. It's been over a month since the last model release. I'm willing to help pitch in and support additional training for this model. The alternative is that I start up my own foundational model using a similar mix of data. I'd rather support this effort, if possible. Please let me know how I can help!