This article has multiple issues. Please help improve it or discuss these issues on the talk page. (Learn how and when to remove these messages)
|
| Part of a series on |
| Machine learning and data mining |
|---|
Vicuna LLM is a large language model (LLM) released by LMSYS. Based on Llama 2, it is an open source project, that has been used in AI research. A non-commercial, public demo of the Vicuna-13b model is available to access using LMSYS.
The methodology of LMSYS's Chatbot Arena is to enable the public at large to contrast and compare the accuracy of LLMs "in the wild" (an example of citizen science) and to vote on their output; a question-and-answer chat format is used. At the beginning of each round two LLM chatbots from a diverse pool of nine are presented randomly and anonymously, their identities only being revealed upon voting on their answers. The user has the option of either replaying ("regenerating") a round, or beginning an entirely fresh one with new LLMs. (The user also has the option of choosing which LLMs to do battle.)[relevant?]