Closed robertgshaw2-neuralmagic closed 4 months ago
SUMMARY:
gc.collect()
thanks
The del is a custom __del__ for VLLMModelRunner ... I am hesitant to touch that code to avoid upstream sync issues.
del
__del__
VLLMModelRunner
But can try it there...
SUMMARY:
gc.collect()
seems to force this to happen