search

mlabonne / llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
https://mlabonne.github.io/blog/
Apache License 2.0
39.18k stars 4.14k forks source link

cuda out of memory #5

Closed Mr-Nobody1 closed 1 year ago

Mr-Nobody1 commented 1 year ago

VRAM doesn't clear even when I run cell [7]. image

mlabonne commented 1 year ago

Hmm weird usually it works. In this case, I recommend restarting the notebook, executing the first three cells (so you have the required parameters), and then running the model for inference.