Adding new entries - Githubissues

eugeneyan / open-llms

📋 A list of open LLMs available for commercial use.

Apache License 2.0

10.88k stars 692 forks source link

Adding new entries #89

Open ozppupbg opened 3 months ago

ozppupbg commented 3 months ago

Hello,

I'm queueing up some updates for new entries and have some questions:

Do you prefer pull requests with multiple new entries, or separate pull requests for each new entry?
There seem to be some releases which claim free commercial licensing, if you register or notify them. E.g.: https://github.com/InternLM/InternLM?tab=readme-ov-file#license Do you want do add such entries?

eugeneyan commented 3 months ago

first, thank you for offering to contribute!

one PR per entry might be simpler to review and approve.

for those that require registration/notification, lets leave out for now? unless they're llama3 quality it may make the list hard to navigate

ozppupbg commented 3 months ago

Ok.

For the licenses I was thinking about adding some columns with symbols or simple checkmarks for various use-cases. Because, e.g. for synthetic dataset creation it is already very difficult to find a model. "Requires registration" could be just another part of this information.

The registration models seem to be primarily from China, but I have not checked their benchmarks in detail.

ozppupbg commented 3 months ago

I came across a number of additional questions:

WizardLM 2 was released in April, but the official weights were removed. However, there are unofficial Huggingface repos with copies of the files. Should I add these?
There is stuff like Starling-LM-7B-beta, which is under an open license, but trained of OpenAI outputs, so is "not allowed to compete with OpenAI" - whatever that means... What is your take on adding such models?
For MoE models it is common to add the number of active parameters in addition to the total parameters. Should these be added?