Fine_tune_PaliGemma_for_image_>JSON.ipynb: Kernel crashes

[lhericourt]

Hi,

I am running the notebook to finetune PaliGemma, I am running it on GCP and tried different machine configurations

• T4 4vCPU 15GB RAM,
• L4 4vCPU 16GB RAM,
• A100 GPU (40Go) with 12vCPU and 85GB RAM And each time the kernel dies without any explanation... RAM does seem to explode neither VRAM.

I am running the notebook on:

• Debian11
• Python 3.10.14
• Transformers 4.42.0.dev0
• Datasets 2.19.2
• lightning 2.2.5
• accelerate 0.31.0
• bitsandbytes 0.43.1

Is anyone experiencing the same issus ?