Closed TheMadBevah closed 4 months ago
I am not sure yet if the server will pull the deployed model whenever it starts (i.e. we only need to re-start the server to update it) or whether the model needs to be bundled alongside the server (i.e. we need to re-deploy the server to update).
This will depend on the specific implementation, so if you can, try to pull the model from W&B whenever the server starts (or even upon request?) so that we don't need to re-deploy the server everytime there is a new model. However, this will mean decreased performance, so if performance is an issue, maybe we'll need to change this.
It does pull the newest on startup of the server. Due to it being down usually, it should have the newest one available.
Possibilities: