search

huggingface / text-generation-inference

Large Language Model Text Generation Inference
http://hf.co/docs/text-generation-inference
Apache License 2.0
8.96k stars 1.06k forks source link

Disable logging of "grammar" parameter #2380

Open sfbemerk opened 2 months ago

sfbemerk commented 2 months ago

Feature request

Remove full logging of the "grammar" parameter on each request. Possible replacements: a) log only "None" vs "Some" b) add a config argument to enable/disable full logging

Motivation

Any application with high requirements to data privacy protection must ensure that no user input is persisted or logged. The parameters that are most likely to contain sensitive information are

While prompt and tools are currently not logged, the grammar parameter IS logged, which could disclose sensitive user input.

Your contribution

-

ErikKaum commented 2 months ago

Hi @sfbemerk 👋

Thanks for pointing this out, it think this is something we could add. Would you like to take a stab at implementing this? 100% if not, I don't have bandwidth to take it immediately but should be able next week 👍