search

Jeffser / Alpaca

🦙 An Ollama client made with GTK4 and Adwaita
https://jeffser.com/alpaca
GNU General Public License v3.0
447 stars 46 forks source link

Dowload Progression Bar always stops, can't download models. #375

Open bpjoestar opened 1 week ago

bpjoestar commented 1 week ago

Hey, I just tried the Alpaca Flatpak, it works perfectly fine with small Models. But whenever I try to download Models bigger than 6GB, the Progression Bar always stops. Llama 3.1 models, as well as Gemma2 models, but also Llava models for Image Recognition.

I just tried it again, to be completely sure. And yes, I can download a 700mb model without any issues.

Jeffser commented 6 days ago

Hi, does it stop at the end? you might want to give it a minute or two

bpjoestar commented 6 days ago

Screenshot From 2024-11-19 03-57-51

Yesterday I tried to load a couple models over night, they got stuck. I just tried to load a model again and it's also stuck at 77.81% But the smaller Llama model installs perfectly fine. I also trashed to userdata and tried it again.

Jeffser commented 6 days ago

that's strange, could you give me the output of running the app from a terminal? flatpak run com.jeffser.Alpaca, you can also get the logs by going to About Alpaca > Troubleshooting > Debugging Information

bpjoestar commented 5 days ago

I just cleared Alpaca again and tried to download a model. I also have the logs, I hope there is nothing too sensitive, to share. I just put 3 X's on SSH. Also my download speed is really bad, but I have a stable connection via LAN. And I can download smaller models just fine. I hope thats enough info, this time it stopped at 51.89% and I cannot continue and when I close Alpaca, I have to download everything again. But the Userdata is at 7,2GB, so it downloaded something, but it can't finish I guess.

INFO [main.py | main] Alpaca version: 2.7.0 INFO [connection_handler.py | start] Starting Alpaca's Ollama instance... INFO [connection_handler.py | start] Started Alpaca's Ollama instance Couldn't find '/home/bp/.var/app/com.jeffser.Alpaca/data/.ollama/id_ed25519'. Generating new private key. Your new public key is:

ssh-xxx

2024/11/20 01:15:01 routes.go:1153: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_DEBUG:true OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11435 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/home/bp/.var/app/com.jeffser.Alpaca/data/.ollama/models OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost: https://localhost: http://127.0.0.1 https://127.0.0.1 http://127.0.0.1: https://127.0.0.1: http://0.0.0.0 https://0.0.0.0 http://0.0.0.0: https://0.0.0.0: app:// file:// tauri://] OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]" time=2024-11-20T01:15:01.238+01:00 level=INFO source=images.go:753 msg="total blobs: 0" time=2024-11-20T01:15:01.238+01:00 level=INFO source=images.go:760 msg="total unused blobs removed: 0" time=2024-11-20T01:15:01.238+01:00 level=INFO source=routes.go:1200 msg="Listening on 127.0.0.1:11435 (version 0.3.12)" time=2024-11-20T01:15:01.239+01:00 level=INFO source=common.go:135 msg="extracting embedded files" dir=/home/bp/.var/app/com.jeffser.Alpaca/cache/tmp/ollama/ollama3310335351/runners time=2024-11-20T01:15:01.239+01:00 level=DEBUG source=common.go:168 msg=extracting runner=cpu payload=linux/amd64/cpu/libggml.so.gz time=2024-11-20T01:15:01.239+01:00 level=DEBUG source=common.go:168 msg=extracting runner=cpu payload=linux/amd64/cpu/libllama.so.gz time=2024-11-20T01:15:01.239+01:00 level=DEBUG source=common.go:168 msg=extracting runner=cpu payload=linux/amd64/cpu/ollama_llama_server.gz time=2024-11-20T01:15:01.239+01:00 level=DEBUG source=common.go:168 msg=extracting runner=cpu_avx payload=linux/amd64/cpu_avx/libggml.so.gz time=2024-11-20T01:15:01.239+01:00 level=DEBUG source=common.go:168 msg=extracting runner=cpu_avx payload=linux/amd64/cpu_avx/libllama.so.gz time=2024-11-20T01:15:01.239+01:00 level=DEBUG source=common.go:168 msg=extracting runner=cpu_avx payload=linux/amd64/cpu_avx/ollama_llama_server.gz time=2024-11-20T01:15:01.239+01:00 level=DEBUG source=common.go:168 msg=extracting runner=cpu_avx2 payload=linux/amd64/cpu_avx2/libggml.so.gz time=2024-11-20T01:15:01.239+01:00 level=DEBUG source=common.go:168 msg=extracting runner=cpu_avx2 payload=linux/amd64/cpu_avx2/libllama.so.gz time=2024-11-20T01:15:01.239+01:00 level=DEBUG source=common.go:168 msg=extracting runner=cpu_avx2 payload=linux/amd64/cpu_avx2/ollama_llama_server.gz time=2024-11-20T01:15:01.239+01:00 level=DEBUG source=common.go:168 msg=extracting runner=cuda_v11 payload=linux/amd64/cuda_v11/libggml.so.gz time=2024-11-20T01:15:01.239+01:00 level=DEBUG source=common.go:168 msg=extracting runner=cuda_v11 payload=linux/amd64/cuda_v11/libllama.so.gz time=2024-11-20T01:15:01.239+01:00 level=DEBUG source=common.go:168 msg=extracting runner=cuda_v11 payload=linux/amd64/cuda_v11/ollama_llama_server.gz time=2024-11-20T01:15:01.239+01:00 level=DEBUG source=common.go:168 msg=extracting runner=cuda_v12 payload=linux/amd64/cuda_v12/libggml.so.gz time=2024-11-20T01:15:01.239+01:00 level=DEBUG source=common.go:168 msg=extracting runner=cuda_v12 payload=linux/amd64/cuda_v12/libllama.so.gz time=2024-11-20T01:15:01.239+01:00 level=DEBUG source=common.go:168 msg=extracting runner=cuda_v12 payload=linux/amd64/cuda_v12/ollama_llama_server.gz time=2024-11-20T01:15:01.239+01:00 level=DEBUG source=common.go:168 msg=extracting runner=rocm_v60102 payload=linux/amd64/rocm_v60102/libggml.so.gz time=2024-11-20T01:15:01.239+01:00 level=DEBUG source=common.go:168 msg=extracting runner=rocm_v60102 payload=linux/amd64/rocm_v60102/libllama.so.gz time=2024-11-20T01:15:01.239+01:00 level=DEBUG source=common.go:168 msg=extracting runner=rocm_v60102 payload=linux/amd64/rocm_v60102/ollama_llama_server.gz INFO [connection_handler.py | start] client version is 0.3.12 INFO [connection_handler.py | request] GET : http://127.0.0.1:11435/api/tags time=2024-11-20T01:15:07.911+01:00 level=DEBUG source=common.go:294 msg="availableServers : found" file=/home/bp/.var/app/com.jeffser.Alpaca/cache/tmp/ollama/ollama3310335351/runners/cpu/ollama_llama_server time=2024-11-20T01:15:07.911+01:00 level=DEBUG source=common.go:294 msg="availableServers : found" file=/home/bp/.var/app/com.jeffser.Alpaca/cache/tmp/ollama/ollama3310335351/runners/cpu_avx/ollama_llama_server time=2024-11-20T01:15:07.911+01:00 level=DEBUG source=common.go:294 msg="availableServers : found" file=/home/bp/.var/app/com.jeffser.Alpaca/cache/tmp/ollama/ollama3310335351/runners/cpu_avx2/ollama_llama_server time=2024-11-20T01:15:07.911+01:00 level=DEBUG source=common.go:294 msg="availableServers : found" file=/home/bp/.var/app/com.jeffser.Alpaca/cache/tmp/ollama/ollama3310335351/runners/cuda_v11/ollama_llama_server time=2024-11-20T01:15:07.911+01:00 level=DEBUG source=common.go:294 msg="availableServers : found" file=/home/bp/.var/app/com.jeffser.Alpaca/cache/tmp/ollama/ollama3310335351/runners/cuda_v12/ollama_llama_server time=2024-11-20T01:15:07.911+01:00 level=DEBUG source=common.go:294 msg="availableServers : found" file=/home/bp/.var/app/com.jeffser.Alpaca/cache/tmp/ollama/ollama3310335351/runners/rocm_v60102/ollama_llama_server time=2024-11-20T01:15:07.911+01:00 level=INFO source=common.go:49 msg="Dynamic LLM libraries" runners="[cpu_avx2 cuda_v11 cuda_v12 rocm_v60102 cpu cpu_avx]" time=2024-11-20T01:15:07.911+01:00 level=DEBUG source=common.go:50 msg="Override detection logic by setting OLLAMA_LLM_LIBRARY" time=2024-11-20T01:15:07.911+01:00 level=DEBUG source=sched.go:105 msg="starting llm scheduler" time=2024-11-20T01:15:07.912+01:00 level=INFO source=gpu.go:199 msg="looking for compatible GPUs" time=2024-11-20T01:15:07.912+01:00 level=DEBUG source=gpu.go:86 msg="searching for GPU discovery libraries for NVIDIA" time=2024-11-20T01:15:07.912+01:00 level=DEBUG source=gpu.go:468 msg="Searching for GPU library" name=libcuda.so time=2024-11-20T01:15:07.912+01:00 level=DEBUG source=gpu.go:491 msg="gpu library search" globs="[/app/lib/ollama/libcuda.so /app/lib/libcuda.so /usr/lib/x86_64-linux-gnu/GL/default/lib/libcuda.so /usr/lib/x86_64-linux-gnu/openh264/extra/libcuda.so /usr/lib/x86_64-linux-gnu/openh264/extra/libcuda.so /usr/lib/sdk/llvm15/lib/libcuda.so /usr/lib/x86_64-linux-gnu/GL/default/lib/libcuda.so /usr/lib/ollama/libcuda.so /app/plugins/AMD/lib/ollama/libcuda.so /usr/local/cuda/targets//lib/libcuda.so /usr/lib/-linux-gnu/nvidia/current/libcuda.so /usr/lib/-linux-gnu/libcuda.so /usr/lib/wsl/lib/libcuda.so /usr/lib/wsl/drivers//libcuda.so /opt/cuda/lib/libcuda.so /usr/local/cuda/lib/libcuda.so /usr/lib/libcuda.so /usr/local/lib/libcuda.so]" time=2024-11-20T01:15:07.913+01:00 level=DEBUG source=gpu.go:525 msg="discovered GPU libraries" paths=[] time=2024-11-20T01:15:07.913+01:00 level=DEBUG source=gpu.go:468 msg="Searching for GPU library" name=libcudart.so time=2024-11-20T01:15:07.913+01:00 level=DEBUG source=gpu.go:491 msg="gpu library search" globs="[/app/lib/ollama/libcudart.so /app/lib/libcudart.so /usr/lib/x86_64-linux-gnu/GL/default/lib/libcudart.so /usr/lib/x86_64-linux-gnu/openh264/extra/libcudart.so /usr/lib/x86_64-linux-gnu/openh264/extra/libcudart.so /usr/lib/sdk/llvm15/lib/libcudart.so /usr/lib/x86_64-linux-gnu/GL/default/lib/libcudart.so /usr/lib/ollama/libcudart.so /app/plugins/AMD/lib/ollama/libcudart.so /app/lib/ollama/libcudart.so /usr/local/cuda/lib64/libcudart.so /usr/lib/x86_64-linux-gnu/nvidia/current/libcudart.so /usr/lib/x86_64-linux-gnu/libcudart.so /usr/lib/wsl/lib/libcudart.so /usr/lib/wsl/drivers//libcudart.so /opt/cuda/lib64/libcudart.so /usr/local/cuda/targets/aarch64-linux/lib/libcudart.so /usr/lib/aarch64-linux-gnu/nvidia/current/libcudart.so /usr/lib/aarch64-linux-gnu/libcudart.so /usr/local/cuda/lib/libcudart.so /usr/lib/libcudart.so /usr/local/lib/libcudart.so*]" time=2024-11-20T01:15:07.914+01:00 level=DEBUG source=gpu.go:525 msg="discovered GPU libraries" paths="[/app/lib/ollama/libcudart.so.12.4.99 /app/lib/ollama/libcudart.so.11.3.109]" cudaSetDevice err: 35 time=2024-11-20T01:15:07.914+01:00 level=DEBUG source=gpu.go:537 msg="Unable to load cudart" library=/app/lib/ollama/libcudart.so.12.4.99 error="your nvidia driver is too old or missing. If you have a CUDA GPU please upgrade to run ollama" cudaSetDevice err: 35 time=2024-11-20T01:15:07.914+01:00 level=DEBUG source=gpu.go:537 msg="Unable to load cudart" library=/app/lib/ollama/libcudart.so.11.3.109 error="your nvidia driver is too old or missing. If you have a CUDA GPU please upgrade to run ollama" time=2024-11-20T01:15:07.914+01:00 level=WARN source=amd_linux.go:60 msg="ollama recommends running the https://www.amd.com/en/support/linux-drivers" error="amdgpu version file missing: /sys/module/amdgpu/version stat /sys/module/amdgpu/version: no such file or directory" time=2024-11-20T01:15:07.914+01:00 level=DEBUG source=amd_linux.go:103 msg="evaluating amdgpu node /sys/class/kfd/kfd/topology/nodes/0/properties" time=2024-11-20T01:15:07.914+01:00 level=DEBUG source=amd_linux.go:128 msg="detected CPU /sys/class/kfd/kfd/topology/nodes/0/properties" time=2024-11-20T01:15:07.914+01:00 level=DEBUG source=amd_linux.go:103 msg="evaluating amdgpu node /sys/class/kfd/kfd/topology/nodes/1/properties" time=2024-11-20T01:15:07.914+01:00 level=DEBUG source=amd_linux.go:218 msg="mapping amdgpu to drm sysfs nodes" amdgpu=/sys/class/kfd/kfd/topology/nodes/1/properties vendor=4098 device=29605 unique_id=16327787963636564795 time=2024-11-20T01:15:07.914+01:00 level=DEBUG source=amd_linux.go:252 msg=matched amdgpu=/sys/class/kfd/kfd/topology/nodes/1/properties drm=/sys/class/drm/card1/device time=2024-11-20T01:15:07.914+01:00 level=DEBUG source=amd_linux.go:284 msg="amdgpu memory" gpu=0 total="16.0 GiB" time=2024-11-20T01:15:07.914+01:00 level=DEBUG source=amd_linux.go:285 msg="amdgpu memory" gpu=0 available="14.9 GiB" time=2024-11-20T01:15:07.914+01:00 level=DEBUG source=amd_common.go:18 msg="evaluating potential rocm lib dir /app/lib/ollama" time=2024-11-20T01:15:07.914+01:00 level=DEBUG source=amd_common.go:18 msg="evaluating potential rocm lib dir /app/lib" time=2024-11-20T01:15:07.914+01:00 level=DEBUG source=amd_common.go:18 msg="evaluating potential rocm lib dir /usr/lib/x86_64-linux-gnu/GL/default/lib" time=2024-11-20T01:15:07.914+01:00 level=DEBUG source=amd_common.go:18 msg="evaluating potential rocm lib dir /usr/lib/x86_64-linux-gnu/openh264/extra" time=2024-11-20T01:15:07.914+01:00 level=DEBUG source=amd_common.go:18 msg="evaluating potential rocm lib dir /usr/lib/x86_64-linux-gnu/openh264/extra" time=2024-11-20T01:15:07.914+01:00 level=DEBUG source=amd_common.go:18 msg="evaluating potential rocm lib dir /usr/lib/sdk/llvm15/lib" time=2024-11-20T01:15:07.914+01:00 level=DEBUG source=amd_common.go:18 msg="evaluating potential rocm lib dir /usr/lib/x86_64-linux-gnu/GL/default/lib" time=2024-11-20T01:15:07.914+01:00 level=DEBUG source=amd_common.go:18 msg="evaluating potential rocm lib dir /usr/lib/ollama" time=2024-11-20T01:15:07.914+01:00 level=DEBUG source=amd_common.go:18 msg="evaluating potential rocm lib dir /app/plugins/AMD/lib/ollama" time=2024-11-20T01:15:07.915+01:00 level=DEBUG source=amd_linux.go:337 msg="rocm supported GPUs" types="[gfx1010 gfx1030 gfx1100 gfx1101 gfx1102 gfx900 gfx906 gfx908 gfx90a gfx940 gfx941 gfx942]" time=2024-11-20T01:15:07.915+01:00 level=INFO source=amd_linux.go:346 msg="amdgpu is supported" gpu=0 gpu_type=gfx1030 time=2024-11-20T01:15:07.916+01:00 level=INFO source=types.go:107 msg="inference compute" id=0 library=rocm variant="" compute=gfx1030 driver=0.0 name=1002:73a5 total="16.0 GiB" available="14.9 GiB" [GIN] 2024/11/20 - 01:15:07 | 200 | 136.701µs | 127.0.0.1 | GET "/api/tags" INFO [model_widget.py | pull_model] Pulling model: llama3.1:8b-instruct-q8_0 INFO [connection_handler.py | request] POST : http://127.0.0.1:11435/api/pull time=2024-11-20T01:17:03.724+01:00 level=INFO source=download.go:175 msg="downloading cc04e85e1f86 in 16 533 MB part(s)" time=2024-11-20T01:17:59.885+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 3 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:18:06.885+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 4 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:19:15.884+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 5 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:19:53.121+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 12 attempt 0 failed: unexpected EOF, retrying in 1s" time=2024-11-20T01:19:54.409+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 10 attempt 0 failed: unexpected EOF, retrying in 1s" time=2024-11-20T01:19:57.885+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 6 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:20:08.649+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 11 attempt 0 failed: unexpected EOF, retrying in 1s" time=2024-11-20T01:20:19.854+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 13 attempt 0 failed: unexpected EOF, retrying in 1s" time=2024-11-20T01:20:28.978+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 2 attempt 0 failed: unexpected EOF, retrying in 1s" time=2024-11-20T01:20:29.885+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 1 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:20:47.241+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 14 attempt 0 failed: unexpected EOF, retrying in 1s" time=2024-11-20T01:21:28.204+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 15 attempt 0 failed: unexpected EOF, retrying in 1s" time=2024-11-20T01:21:32.835+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 9 attempt 0 failed: unexpected EOF, retrying in 1s" time=2024-11-20T01:22:10.979+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 2 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:22:47.241+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 14 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:23:13.886+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 6 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:24:12.885+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 5 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:24:58.597+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 8 attempt 0 failed: unexpected EOF, retrying in 1s" time=2024-11-20T01:25:10.205+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 15 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:25:30.482+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 7 attempt 0 failed: unexpected EOF, retrying in 1s" time=2024-11-20T01:25:47.987+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 1 attempt 0 failed: unexpected EOF, retrying in 1s" time=2024-11-20T01:27:12.038+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 13 attempt 1 failed: unexpected EOF, retrying in 2s" time=2024-11-20T01:27:21.399+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 3 attempt 0 failed: unexpected EOF, retrying in 1s" time=2024-11-20T01:27:34.194+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 4 attempt 0 failed: unexpected EOF, retrying in 1s" time=2024-11-20T01:27:39.255+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 10 attempt 1 failed: unexpected EOF, retrying in 2s" time=2024-11-20T01:28:20.410+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 2 attempt 1 failed: unexpected EOF, retrying in 2s" time=2024-11-20T01:28:59.400+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 3 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:29:11.531+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 11 attempt 1 failed: unexpected EOF, retrying in 2s" time=2024-11-20T01:29:23.750+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 9 attempt 1 failed: unexpected EOF, retrying in 2s" time=2024-11-20T01:29:31.411+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 2 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:30:23.884+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 0 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:30:35.122+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 12 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:30:36.482+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 7 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:30:56.256+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 10 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:31:00.194+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 4 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:31:06.242+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 14 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:31:13.532+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 11 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:32:03.091+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 13 attempt 2 failed: unexpected EOF, retrying in 4s" time=2024-11-20T01:32:06.146+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 9 attempt 2 failed: unexpected EOF, retrying in 4s" time=2024-11-20T01:32:08.092+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 13 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:35:02.242+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 6 attempt 0 failed: unexpected EOF, retrying in 1s" time=2024-11-20T01:35:10.336+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 8 attempt 1 failed: unexpected EOF, retrying in 2s" time=2024-11-20T01:36:06.994+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 1 attempt 1 failed: unexpected EOF, retrying in 2s" time=2024-11-20T01:36:56.940+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 15 attempt 1 failed: unexpected EOF, retrying in 2s" time=2024-11-20T01:37:04.229+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 5 attempt 0 failed: unexpected EOF, retrying in 1s" time=2024-11-20T01:37:21.726+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 3 attempt 1 failed: unexpected EOF, retrying in 2s" time=2024-11-20T01:38:04.533+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 11 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:39:14.412+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 2 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:39:24.257+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 10 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:40:06.545+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 8 attempt 2 failed: unexpected EOF, retrying in 4s" time=2024-11-20T01:40:15.666+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 12 attempt 1 failed: unexpected EOF, retrying in 2s" time=2024-11-20T01:41:16.596+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 13 attempt 3 failed: unexpected EOF, retrying in 8s" time=2024-11-20T01:41:20.580+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 14 attempt 1 failed: read tcp 192.168.2.106:46108->162.159.140.238:443: read: connection reset by peer, retrying in 2s" time=2024-11-20T01:41:25.597+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 13 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:41:42.418+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 0 attempt 0 failed: unexpected EOF, retrying in 1s" time=2024-11-20T01:42:12.430+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 9 attempt 3 failed: unexpected EOF, retrying in 8s" time=2024-11-20T01:42:21.430+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 9 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:42:25.523+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 7 attempt 1 failed: unexpected EOF, retrying in 2s" time=2024-11-20T01:42:58.237+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 4 attempt 1 failed: unexpected EOF, retrying in 2s" time=2024-11-20T01:43:39.670+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 1 attempt 2 failed: unexpected EOF, retrying in 4s" time=2024-11-20T01:43:44.671+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 1 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:47:11.667+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 12 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:48:07.189+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 8 attempt 3 failed: unexpected EOF, retrying in 8s" time=2024-11-20T01:48:12.672+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 10 attempt 2 failed: unexpected EOF, retrying in 4s" time=2024-11-20T01:48:16.190+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 8 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:48:17.673+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 10 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:49:32.413+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 2 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:50:15.561+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 3 attempt 2 failed: unexpected EOF, retrying in 4s" time=2024-11-20T01:50:20.562+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 3 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:50:32.941+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 15 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:50:52.178+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 11 attempt 2 failed: unexpected EOF, retrying in 4s" time=2024-11-20T01:50:57.180+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 11 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:53:02.321+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 6 attempt 1 failed: unexpected EOF, retrying in 2s" time=2024-11-20T01:55:01.390+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 14 attempt 2 failed: unexpected EOF, retrying in 4s" time=2024-11-20T01:55:06.390+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 14 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:55:54.608+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 2 attempt 2 failed: unexpected EOF, retrying in 4s" time=2024-11-20T01:55:59.609+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 2 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:56:04.905+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 8 attempt 4 failed: unexpected EOF, retrying in 16s" time=2024-11-20T01:56:21.906+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 8 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T01:56:22.525+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 10 attempt 3 failed: unexpected EOF, retrying in 8s" time=2024-11-20T01:56:31.527+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 10 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T02:02:16.907+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 8 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T02:02:25.668+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 12 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T02:04:50.563+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 3 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T02:05:41.795+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 14 attempt 3 failed: unexpected EOF, retrying in 8s" time=2024-11-20T02:05:42.930+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 7 attempt 2 failed: unexpected EOF, retrying in 4s" time=2024-11-20T02:05:50.796+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 14 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T02:06:18.469+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 10 attempt 4 failed: unexpected EOF, retrying in 16s" time=2024-11-20T02:06:34.746+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 4 attempt 2 failed: unexpected EOF, retrying in 4s" time=2024-11-20T02:06:35.470+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 10 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T02:06:39.747+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 4 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T02:07:54.125+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 6 attempt 2 failed: unexpected EOF, retrying in 4s" time=2024-11-20T02:07:59.126+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 6 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T02:08:33.346+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 9 attempt 4 failed: unexpected EOF, retrying in 16s" time=2024-11-20T02:08:50.347+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 9 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T02:11:30.931+01:00 level=INFO source=download.go:370 msg="cc04e85e1f86 part 7 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2024-11-20T02:12:57.805+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 8 attempt 5 failed: unexpected EOF, retrying in 32s" time=2024-11-20T02:13:26.335+01:00 level=INFO source=download.go:291 msg="cc04e85e1f86 part 10 attempt 5 failed: unexpected EOF, retrying in 32s" [GIN] 2024/11/20 - 02:13:58 | 200 | 56m56s | 127.0.0.1 | POST "/api/pull"

Jeffser commented 3 days ago

it seems like the Ollama instance is not downloading the model correctly, I updated the Ollama instance in Alpaca 2.8.0, could you check if it works for you? thanks