We only have a rudimentary inference interface (and CLI once #18 is finished). Unfortunately, everyone who wants to try our models needs to install the correct Jax version and drivers and have a GPU large enough to handle our models at reasonable speeds. To allow for faster experimentation of other researchers, we should provide them with a web API.\
This issue tracks the progress of such an API.
ClashLuke
commented
2 years ago
We only have a rudimentary inference interface (and CLI once #18 is finished). Unfortunately, everyone who wants to try our models needs to install the correct Jax version and drivers and have a GPU large enough to handle our models at reasonable speeds. To allow for faster experimentation of other researchers, we should provide them with a web API.\ This issue tracks the progress of such an API.