search

anarchy-ai / LLM-VM

irresponsible innovation. Try now at https://chat.dev/
https://anarchy.ai/
MIT License
465 stars 150 forks source link

parallel sampling with TGI #369

Closed VictorOdede closed 7 months ago

VictorOdede commented 8 months ago

https://huggingface.co/docs/text-generation-inference/index

daspartho commented 7 months ago

closing since TGI is not open source licence https://github.com/huggingface/text-generation-inference/issues/726