How to disable ggml logging?

rustformers / llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

https://docs.rs/llm/latest/llm/

Apache License 2.0

6.07k stars 355 forks source link

How to disable ggml logging? #433

Open mrwilby opened 1 year ago

mrwilby commented 1 year ago

I read that when using metal acceleration, ggml may emit logging. How can we disable this? It's overwhelming all the other output from my program making it difficult to see what's important (to me).

During inferencing I see lines such as:

... ggml_metal_graph_compute_block_invoke: encoding node 543, op = MUL_MAT ...

Is it possible to disable this somehow?

LLukas22 commented 1 year ago

The logging is generated from the ggml side and there is currently no way to disable it, with the upcoming ggml update it should be gone but it's currently unstable on macos. See https://github.com/rustformers/llm/pull/428.