search

LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with a KoboldAI UI
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.41k stars 318 forks source link

Loading percentage bar #728

Open marco-trovato opened 4 months ago

marco-trovato commented 4 months ago

The loading time can be time intensive, is it possible to add a visual feedback in the terminal output during loading the model file?

Even just a simple "12%" or a printing a series of dots [....... ]

This program is awesome!

LostRuins commented 4 months ago

Right now it actually does output a series of dots, however on some terminals they might not be immediately flushed to stdout

marco-trovato commented 1 month ago

Right now it actually does output a series of dots, however on some terminals they might not be immediately flushed to stdout

This is exactly the issue, is it possible to make it start writing dots immediately? In theory it should be a small change to implement this feature