lm-sys / FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Apache License 2.0
36.94k stars 4.55k forks source link

What is gpt2-chatbot #3296

Open fakerybakery opened 6 months ago

fakerybakery commented 6 months ago

Hi, Thank you for releasing the Arena. Which model is gpt2-chatbot? Thanks!

alexanderatallah commented 6 months ago

^ the github issue that started it all

defteame commented 6 months ago

So what is the policy for adding new models to the arena then? Any big company can do viral marketing campaign now through this platform without explaining anything? So much for transparency and open-source approach. If the idea of AI benchmarking is now gaslighting the community - then good job guys, truly the way to achieve safe AGI

raulmarindev commented 6 months ago

This is the policy:

image

https://lmsys.org/blog/2024-03-01-policy/#our-policy

carterprince commented 6 months ago

It's a new, unreleased model by OpenAI. We don't know if it's a new architecture or they're doing something different with the base GPT-4 model, or what. We're pretty sure it's not 1.5B or 3B params as some were claiming, because of its high level of knowledge.

https://rentry.org/GPT2

Rahjooyan commented 6 months ago

please fix gpt2-chatbot problem. It's currently unavailable. Thanks.

upintheairsheep commented 5 months ago

It's GPT-4o (Omni). deluxe-chat-v1.2 was the previous name for gpt2-chatbot