ChenRocks / UNITER

Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"
https://arxiv.org/abs/1909.11740
777 stars 109 forks source link

Pretraining from scratch on small data #74

Open yonatanbitton opened 3 years ago

yonatanbitton commented 3 years ago

Hello. I want to pre-train myself.

I try running the CMD here: https://github.com/ChenRocks/UNITER#pre-tranining

horovodrun -np 8 python pretrain.py --config config/pretrain-indomain-base-8gpu.json \
    --output_dir $PRETRAIN_EXP

(after launching the docker)

But I receieve: [1,0]<stderr>:RuntimeError: cuda runtime error (35) : CUDA driver version is insufficient for CUDA runtime version at ../torch/csrc/cuda/Module.cpp:33

I use Cuda 10.2.

Do you know how can I solve it?

I addition, I would like to ask how long should the pretraining take?

Thank you