Open PrakharSingh0908 opened 2 weeks ago
This is currently done to reduce cost of keeping a GPU around when there isn't any jobs running. If there are multiple jobs done in succession, the container will be re-used and the zkey + GPU will not be cold started
It be good if you guys make some sort of server mode which will just take witness as a request and generate proof as a response. I think it doesn't really make sense to load zkey and initialize GPU on every run.