Jeffser / Alpaca

An Ollama client made with GTK4 and Adwaita
https://jeffser.com/alpaca
GNU General Public License v3.0
419 stars 44 forks source link

Pause & resume feature for model download #163

Closed ecelia closed 3 months ago

ecelia commented 3 months ago

If possible, a pause and resume feature for downloading big models would make sense.

olumolu commented 3 months ago

The issue is this feature is not available in ollama as ollama is the backend of this this seems to be extremely hard to implement i request you to also post a feature request in ollama github. So it can be solved.

ecelia commented 3 months ago

Apparently an environment variable OLLAMA_NOPRUNE must be set for an api pull in order to resume downloads.

https://github.com/ollama/ollama/issues/2463#issuecomment-1938872167 https://github.com/ollama/ollama/issues/695#issuecomment-1749043351

Jeffser commented 3 months ago

yeah the problem with this is that, OLLAMA_NOPRUNE is meant to recover downloads that have being interrupted by the process dying or the computer turning off, it isn't possible to, let's say, pause one download and continue with another one at the same time. If Ollama includes an actual way of doing this I will add it, but as for now, there's nothing I can do