Only Available on Linux?

RUC-NLPIR / FlashRAG

⚡FlashRAG: A Python Toolkit for Efficient RAG Research

https://arxiv.org/abs/2405.13576

MIT License

890 stars 69 forks source link

Only Available on Linux? #5

Closed AldousShou closed 1 month ago

AldousShou commented 1 month ago

I tried to install it on my apple silicon mac, but I ran into issue:

AssertionError: vLLM only supports Linux platform (including WSL).

How should I solve the problem?

Thx for you help!

ignorejjj commented 1 month ago

It seems that vllm does not support mac yet.

You can delete vllm from requirement.txt and check if other packages can be installed properly. If all other packages support Mac and can be installed normally, you can use other generators besides vllm (e.g. fastchat, hf).