questions about rapids folder

opengear-project / GEAR

GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM

MIT License

128 stars 10 forks source link

questions about rapids folder #3

Closed hzfengfengxia closed 5 months ago

hzfengfengxia commented 5 months ago

I saw that some packages in the requirements.txt are installed via local .whl files, especially in the folder named rapids. However, I have not found this rapids folder. How should I solve this problem?

HaoKang-Timmy commented 5 months ago

I will modify them. Currently I suggest you install transformers and GEARLM at the newest version. And then it may run.

hzfengfengxia commented 5 months ago

I will modify them. Currently I suggest you install transformers and GEARLM at the newest version. And then it may run.

thankyou！