Open rajasegar opened 1 month ago
One of the things that makes me cringe is when swapping between models, it never releases the memory when I'm done using it. It's just piles up
More info on how ollama does it https://github.com/ollama/ollama/issues/1339
One of the things that makes me cringe is when swapping between models, it never releases the memory when I'm done using it. It's just piles up
More info on how ollama does it https://github.com/ollama/ollama/issues/1339