search

mzbac / AutoGPTQ-API

Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
91 stars 14 forks source link

Usage in streaming api #2

Open tridungduong16 opened 1 year ago

tridungduong16 commented 1 year ago

How can I send a request when running streaming_api.py.