search

microsoft / vattention

Dynamic Memory Management for Serving LLMs without PagedAttention
MIT License
248 stars 16 forks source link

Hangs on Installing sarathi-lean #18

Closed neur1n closed 1 month ago

neur1n commented 1 month ago

I ran pip install -e . in the sarathi-lean folder but it hangs on "Installing build dependencies ... ", despite that I install all the dependencies listed in requirements.txt manually.

Any idea? Thanks in advanced.

neur1n commented 1 month ago

python setup.py develop works for me though.