sotopia-lab / sotopia

Sotopia: an Open-ended Social Learning Environment (ICLR 2024 spotlight)
https://docs.sotopia.world
MIT License
148 stars 19 forks source link

[FEAT]: Adding models for benchmarking #29

Closed clementou closed 6 months ago

clementou commented 7 months ago

Description

TogetherAI models:

Hugging Face models:

Tsinghua:

FastChat:

Nvidia:

Proprietary:

Anthropic:

Google:

Mistral:

Perplexity:

Additional Information

No response

ProKil commented 7 months ago

@clementou I feel like it is not scalable to add more models to LLM_Name. Since there are libraries like LiteLLM which converts all models to a uniform api, we can should allow using custom endpoints and not overflow our code with a long list of LLMs we support.

@lwaekfjlk @ruiyiw @Jasonqi146 @sharonwx54 worked on adding a custom model which could support all possible endpoints. There's no need to do repetitive efforts. Could y'all share how to use your custom_model option?

XuhuiZhou commented 7 months ago

Thanks @ProKil! @clementou Feel free to chat with people to figure out their solutions! You can directly post Qs in the sotopia-technical channel (or simply communicate here; i just find people usually don't check this haha)