There is a mysterious new model called gpt2-chatbot accessible from a major LLM benchmarking site. No one knows who made it or what it is, but I have been playing with it a little and it appears to be in the same rough ability level as GPT-4. A mysterious GPT-4 class model? Neat!
Access to the new model is currently restricted to the Chatbot Arena website, albeit in a restricted capacity. Within the site's 'side-by-side' arena mode, where users deliberately choose the model, gpt2-chatbot is subject to a rate limit of eight queries per day, limiting users' ability to thoroughly test it.
A post on X from the organization later confirmed that the chatbot had been temporarily removed 'due to unexpectedly high traffic.' Nevertheless, LMSYS advises staying tuned for its wider releases.
[
add
]
[
|
|
...
]