-
报错内容：
```
Traceback (most recent call last):
File "./graphgpt/eval/run_graphgpt.py", line 244, in
run_eval(args, args.num_gpus)
File "./graphgpt/eval/run_graphgpt.py", line 98, in run_ev…
-
I hope you are doing well. I came across a reference to the "Web Pipeline" in the paper "Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research" and I am very intereste…
-
Hi, thanks for your great work.
While running run_pretraining.py, I kept getting OOM for any size of the matrix.
I already reduce the batch size to 1 but didn't help.
I'm using 960M, TensorFlow-gpu…
-
what is the dataset of pre-training model?
I use pre-training model to recognition,but the recognition rate is not good?
what should i do? Can i use a new dataset to re-training or fine tuning on t…
-
I admire and am interested in your work and would like to follow up on your work. Will you make the pre-training code and training dataset public?
-
Hi! I'm training the pretraining process on RefCOCO* datasets.
But, the CPU memory increasing from 18G to 22G after 1 epoch.
I'm worry about after a few epochs later, the CPU MEMORY will face OOM p…
-
hi，it seems like that the dataset of pretrain stage1 and stage2 mentioned in the blip2 paper contains coco,cc3m,cc12m,sbu and laion ,but the config file only include coco and vg dataset.which is true …
-
Hi, what is your mvm accuracy of pretrained model? I only got about 30% when pretraining and wanted to know if that is normal?
-
Hello, thank you for your sharing firstly!
Based on your tuition, I use create_pretraining_data.py to get a file of tf_example.tfrecord. Then I run run_pretraining.py. After these two steps, I can ge…
-
Hi,
Thank you for the amazing work and code! Will you plan to provide the code and checkpoints for VQA task?
Best,
Ziyan