lm-sys / FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Apache License 2.0
36.58k stars 4.52k forks source link

why the model output text is meaningless? #468

Closed YuanCao1996 closed 1 year ago

YuanCao1996 commented 1 year ago

python3 -m fastchat.serve.test_message --model-name vicuna-7b Models: ['vicuna-7b'] worker_addr: http://localhost:21002 A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions. Human: What are the key differences between renewable and non-renewable energy sources? Assistant: Renewable energy sources are those that can be replenished naturally in a relatively short amount of time, such as solar, wind, hydro, geothermal, and biomass. Non-renewable energy sources, on the other hand, are finite and will eventually be depleted, such as coal, oil, and natural gas. Here are some key differences between renewable and non-renewable energy sources:

  1. Availability: Renewable energy sources are virtually inexhaustible, while non-renewable energy sources are finite and will eventually run out.
  2. Environmental impact: Renewable energy sources have a much lower environmental impact than non-renewable sources, which can lead to air and water pollution, greenhouse gas emissions, and other negative effects.
  3. Cost: Renewable energy sources can be more expensive to initially set up, but they typically have lower operational costs than non-renewable sources.
  4. Reliability: Renewable energy sources are often more reliable and can be used in more remote locations than non-renewable sources.
  5. Flexibility: Renewable energy sources are often more flexible and can be adapted to different situations and needs, while non-renewable sources are more rigid and inflexible.
  6. Sustainability: Renewable energy sources are more sustainable over the long term, while non-renewable sources are not, and their depletion can lead to economic and social instability.

Human: Tell me a story with more than 1000 words. Vors seq So archosti +=rong datasschein sqlite⁵ lean knowledgeходить wild Operationõcommunicplit Milit recently Vors seq So archosti +=rong datasschein sqlite⁵ lean knowledgeходить wild Operationõcommunicplit Milit recently Vors seq So archosti +=rong datasschein sqlite⁵ lean knowledgeходить wild Operationõcommunicplit Milit recently Vors seq So archosti +=rong datasschein sqlite⁵ lean knowledgeходить wild Operationõcommunicplit Milit recently Vors seq So archosti +=rong datasschein sqlite⁵ lean knowledgeходить wild Operationõcommunicplit Milit recently Vors seq So archosti +=rong datasschein sqlite⁵ lean knowledgeходить wild Operationõcommunicplit Milit recently races nyelvenিnit Thé Tas possibility häufig información parti whis

YuanCao1996 commented 1 year ago

the model is vicuna7B v0

MeMeTaTa commented 1 year ago

the model is vicuna7B v0

I used the model vicuna13B v1.1 but the same problem doesn't be solved.

zhisbug commented 1 year ago

Please use v1.1 weight meanwhile use the latest version of fastchat and transformers.