Closed wenshiwei closed 5 years ago
When I run the examples the out-of-memory errors occured,And how to tune infer_batch_size smaller in models?
read the code by yourself and more carefully
When I run the examples the out-of-memory errors occured,And how to tune infer_batch_size smaller in models?