search

hyperonym / basaran

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
MIT License
1.29k stars 81 forks source link

TypeError: issubclass() arg 1 must be a class #253

Open gsuuon opened 10 months ago

gsuuon commented 10 months ago

I'm getting this error with version 0.21.1

docker run -p 80:80 -e MODEL=smallcloudai/Refact-1_6B-fim -e MODEL_TRUST_REMOTE_CODE=true hyperonym/basaran:0.21.1

but not with version 0.19.0

docker run -p 80:80 -e MODEL=smallcloudai/Refact-1_6B-fim -e MODEL_TRUST_REMOTE_CODE=true hyperonym/basaran:0.19.0

Looks like maybe something like this is necessary?

andrewisplinghoff commented 9 months ago

Yeah got the same and fixed it by upgrading to latest Pydantic.