Open sky-fly97 opened 1 month ago
Hello, when I use DocOwl1.5-Chat locally, I found that the model will automatically print results, how to turn off this automatic printing? I am worried that it may affect the inference speed.
Hi, @sky-fly97 you can try commenting out some codes containing print() in app.py and model_worker.py ~
Hello, when I use DocOwl1.5-Chat locally, I found that the model will automatically print results, how to turn off this automatic printing? I am worried that it may affect the inference speed.