project-baize / baize-chatbot

Let ChatGPT teach your own chatbot in hours with a single GPU!
https://arxiv.org/abs/2304.01196
GNU General Public License v3.0
3.15k stars 275 forks source link

demo: Allow passing in 8bit as an argument #29

Closed dnouri closed 1 year ago

dnouri commented 1 year ago

Example usage:

  python app.py \
      decapoda-research/llama-7b-hf \
      project-baize/baize-lora-7B \
      8bit