search

567-labs / fastllm

A collection of LLM services you can self host via docker or modal labs to support your applications development
MIT License
182 stars 23 forks source link

Update Ivan/Wiki branch with an updated generator function #21

Closed jxnl closed 11 months ago

jxnl commented 11 months ago

1) different use of generators as a sequence processor 2) add more benchmarks 3) parameterie gpus