(Do not give GPU time to rest!) Start inferencing next piece as long as current piece is out from the model, leave saving a separated process (for cpu). #31

Closed CarlGao4 closed 10 months ago