search

InternLM / lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
https://lmdeploy.readthedocs.io/en/latest/
Apache License 2.0
4.16k stars 376 forks source link

[Feature] Disable prompt logging #2326

Open Arahizzz opened 3 weeks ago

Arahizzz commented 3 weeks ago

Motivation

I want to disable logging of prompts into console. It seems like currently there is no option for that?

Related resources

No response

Additional context

No response

lvhan028 commented 3 weeks ago

I don't get it. The default log_level is ERROR that won't output prompt at all

Arahizzz commented 3 weeks ago

That pretty much disables all logs. I simply don't want prompt text in console, like --disable-log-requests does in vllm and Aphrodite Engine.

lvhan028 commented 3 weeks ago

I see. Let me investigate --disable-log-requests in vLLM at first.