To support consecutive tasks in open-moe-llm-leaderboard, need to make sure the resource is cleaned up after each task. The specific measures to prevent memory or other issues include the following:
[x] Host Memory Cleanup
[x] Device Memory Cleanup
[x] Redundant Peer Access Enabling
[x] Interface for proactive hooks cleanup (for subsequent running of different frameworks) which will be used in __del__ in leaderboard backend
To support consecutive tasks in open-moe-llm-leaderboard, need to make sure the resource is cleaned up after each task. The specific measures to prevent memory or other issues include the following:
__del__in leaderboard backend