Open jryebread opened 2 months ago
I notice everytime I run the model with run_mp.sh it reloads the checkpoint each time, for speed up is there any easy way to have the model preloaded ? anyone have code change suggestions to achieve this?
Hi. It seems that this is a feature combining gradio_app.py and bash shell script run_mp.sh. I think it is a little bit troublesome to implement this.
Why is there no result after running
I notice everytime I run the model with run_mp.sh it reloads the checkpoint each time, for speed up is there any easy way to have the model preloaded ? anyone have code change suggestions to achieve this?