search

anarchy-ai / LLM-VM

irresponsible innovation. Try now at https://chat.dev/
https://anarchy.ai/
MIT License
477 stars 148 forks source link

parallel sampling with vLLM #370

Open VictorOdede opened 11 months ago

VictorOdede commented 11 months ago

https://vllm.readthedocs.io/en/latest/

rohinish404 commented 10 months ago

Hey, this issue seems interesting! How can i get started with it?

kanyshai20 commented 9 months ago

Hi. Can I work on this?

DAM8410 commented 9 months ago

How do I go about getting assigned, starting, working and finishing an issue so that I may get credit for it? Thank you

lucylililiwang commented 7 months ago

Hi! Can I also please work on this issues? Thank you!

lucylililiwang commented 7 months ago

Hi, just have one question, when doing parallel sampling, should we combine the test_llm_vm.py with the parallel sampling for more efficiency? Thank you!