ai-computing / aicomp

Other
6 stars 0 forks source link

Aggressive memory cleaning support #12

Open ememos opened 3 months ago

ememos commented 3 months ago

A function to forcefully clean the memory is needed. Thus, we can proactively perform garbage collection and cache cleaning.

ememos commented 2 months ago

You can use this feature by enabling the option "force_free_mem=True" during the initialization of the Optimus_p class.