In the open-moe-llm-leaderboard, each task currently initializes separately.
However, the control over resource release timing is not precise, which can lead to potential issues. Specifically, there's a risk that a new ArcherPrefetchHandle instance might be initialized before the previous one is properly destructed.
To prevent this and ensure clean resource management, I propose that we explicitly release resources within the __del__ method. To address this issue, I recommend adding an interface for explicit resource release.
In the open-moe-llm-leaderboard, each task currently initializes separately.
However, the control over resource release timing is not precise, which can lead to potential issues. Specifically, there's a risk that a new
ArcherPrefetchHandleinstance might be initialized before the previous one is properly destructed.To prevent this and ensure clean resource management, I propose that we explicitly release resources within the
__del__method. To address this issue, I recommend adding an interface for explicit resource release.