search

outlines-dev / outlines

Structured Text Generation
https://outlines-dev.github.io/outlines/
Apache License 2.0
6.94k stars 357 forks source link

Adding the option to avoid displaying tqdm bars at inference with `vllm` #1004

Closed BIMM99 closed 6 days ago

BIMM99 commented 1 week ago

Very minor change that adds the possibility to avoid displaying progress bars within outlines. It is not changing the default behaviour and is just about adding an argument (use_tqdm) to the LLM.generate call.

It was useful for a personal project and I did not find another way to do so, so I decided to PR this.

rlouf commented 6 days ago

Thank you for contributing!

BIMM99 commented 6 days ago

Pleasure wasn't too much work tbh ! :)