Thanks for your amazing work! I am wondering whether we have any C/C++ API to use the compiled model. Because we are targeting faster prediction, it probably makes sense to load the compiled model and run the prediction with C/C++ instead of python, so the time intensive applications can use this smoothly.
Thanks for your amazing work! I am wondering whether we have any C/C++ API to use the compiled model. Because we are targeting faster prediction, it probably makes sense to load the compiled model and run the prediction with C/C++ instead of python, so the time intensive applications can use this smoothly.