Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
MIT License
1.29k
stars
81
forks
source link
TypeError: __init__() got an unexpected keyword argument 'load_in_4bit' #227
But this model works perfect with transformers: