search

NielsRogge / Transformers-Tutorials

This repository contains demos I made with the Transformers library by HuggingFace.
MIT License
9.56k stars 1.46k forks source link

Fine_tune_PaliGemma_for_image_>JSON.ipynb CUDA out of memory #437

Open ttkrpink opened 5 months ago

ttkrpink commented 5 months ago

3 24G 3090 GPUs.

The notebook couldn't run on multiple GPUs.

If I run the notebook on one GPU, and set the batch size to 1, the notebook fails with CUDA out of memory.

24G is not enough? Or how can I make it work on multiple GPUs?

Thanks