free up memory - Githubissues

mustafaaljadery / lightning-whisper-mlx

An extremely fast implementation of whisper optimized for Apple Silicon using MLX.

587 stars 30 forks source link

Open brkkaya opened 7 months ago

brkkaya commented 7 months ago

is there any way to free up the memory the model takes?

I tried:

del whisper gc.collect()

but nothing changed.

What can we do to free up the allocated memory?