Model CodeLlama-7b found in /Users/zhangyixin/models.
Model Mistral-7b found in /Users/zhangyixin/models.
Model CodeLlama-34b not found in /Users/zhangyixin/models. Would you like to download it? (y/n) y
Downloading CodeLlama-34b from https://huggingface.co/TheBloke/CodeLlama-34B-Instruct-GGUF/resolve/main/codellama-34b-instruct.Q4_K_M.gguf...
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1165 100 1165 0 0 1437 0 --:--:-- --:--:-- --:--:-- 1441
5 18.8G 5 1081M 0 0 8771k 0 0:37:31 0:02:06 0:35:25 9.9M
Model CodeLlama-7b found in /Users/zhangyixin/models.
Model Mistral-7b found in /Users/zhangyixin/models.
Model CodeLlama-34b found in /Users/zhangyixin/models.
Running server...
DEBUG:asyncio:Using selector: KqueueSelector
INFO: Started server process [57594]
INFO: Waiting for application startup.
INFO: Application startup complete.
INFO: Uvicorn running on http://0.0.0.0:5001 (Press CTRL+C to quit)
Model CodeLlama-7b found in /Users/zhangyixin/models. Model Mistral-7b found in /Users/zhangyixin/models. Model CodeLlama-34b not found in /Users/zhangyixin/models. Would you like to download it? (y/n) y Downloading CodeLlama-34b from https://huggingface.co/TheBloke/CodeLlama-34B-Instruct-GGUF/resolve/main/codellama-34b-instruct.Q4_K_M.gguf... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 1165 100 1165 0 0 1437 0 --:--:-- --:--:-- --:--:-- 1441 5 18.8G 5 1081M 0 0 8771k 0 0:37:31 0:02:06 0:35:25 9.9M
5 18.8G 5 1089M 0 0 8769k 0 0:37:31 0:02:07 0:35:24 9573k 11 18.8G 11 2122M 0 0 6523k 0 0:50:26 0:05:33 0:44:53 3358k 11 18.8G 11 2126M 0 0 6511k 0 0:50:32 0:05:34 0:44:58 3393k
13 18.8G 13 2636M 0 0 5025k 0 1:05:28 0:08:57 0:56:31 2298k
100 18.8G 100 18.8G 0 0 2536k 0 2:09:43 2:09:43 --:--:-- 2221k Running server... DEBUG:asyncio:Using selector: KqueueSelector INFO: Started server process [76092] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:5001 (Press CTRL+C to quit)
^C% (base) zhangyixin@zhangyixins-MacBook-Pro localpilot % INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [76092]
(base) zhangyixin@zhangyixins-MacBook-Pro localpilot % (base) zhangyixin@zhangyixins-MacBook-Pro localpilot % python app.py --setup
Model CodeLlama-7b found in /Users/zhangyixin/models. Model Mistral-7b found in /Users/zhangyixin/models. Model CodeLlama-34b found in /Users/zhangyixin/models. Running server... DEBUG:asyncio:Using selector: KqueueSelector INFO: Started server process [57594] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:5001 (Press CTRL+C to quit)
没有界面,