Fixed error when receiving model response #25 and set autogptq as default.

camenduru / text-generation-webui-colab

A colab gradio web UI for running Large Language Models

The Unlicense

2.08k stars 366 forks source link

Fixed error when receiving model response #25 and set autogptq as default. #26

Closed R3gm closed 1 year ago

R3gm commented 1 year ago

Hello,

I trust this message finds you well. I wanted to inform you that I'm in the process of merging the pull request associated with Issue #25.

The main purpose of this merge is to address the model response error, which has now been resolved successfully. Additionally, "autogptq" has been designated as the default option. This adjustment is expected to enhance the load.

camenduru commented 1 year ago

thanks ❤