search

vicuna-tools / vicuna-installation-guide

The "vicuna-installation-guide" provides step-by-step instructions for installing and configuring Vicuna 13 and 7B
285 stars 34 forks source link

gpu inference #10

Closed ziliangpeng closed 1 year ago

ziliangpeng commented 1 year ago

can you merge this to enable gpu inference? https://github.com/ggerganov/llama.cpp/pull/1642

fredi-python commented 1 year ago

thx for letting me now! merged.