Closed lychees closed 1 year ago
Currently, the model is running under T4 GPU with 16Gb. It might meet out-of-memory error, if too many users have triggered the OOM. We have restarted our demo service and we will update our demo and running on 8 bit precision. Stay tuned.