-
https://fenghz.github.io/Rethinking-ImageNet-Pretraining/
-
If I want to continue pre-training spanbert-base, do I have to load spanbert_base_with_head? so Is there spanbert_base_with_head ? Now you only offer spanbert_large_with_head ( https://dl.fbaipublic…
-
Dear TF Models Garden Maintainer,
today I recognized that TensorFlow 1.15 is no longer available as supported TPU version. That means, it is no longer possible to pretrain [BERT](https://github.com…
-
Hi!
Thanks for the repo, I've recently implemented your model, and I was wondering if you could tell what dataset was used to obtain the pretrained weights?
Thanks
-
Hi @hansen7 ,
Thanks for sharing this great work with us.
I have a question regarding the output log during pretraining. The detail is [here](https://gist.github.com/zshyang/08fb47c7f4aa2835da25e6e…
-
In hte paper is "The pretraining corpus are available at https://drive.google.com/drive/folders/1ST0WD1-hX9XtiPWwCceZbgZlBV0fKPbe. (Supplementary Materials)". The link is not valid (404), is there an…
-
hello, I'm trying to fine-tune my pretrained model trained by my own dataset, but I don't know what is SOURCE_PLANS_IDENTIFIER and TARGET_PLANS_IDENTIFIER,can you help me?
![image](https://github.com…
-
We have made a number of changes to our bert modeling code of late.
Primary changes are https://github.com/keras-team/keras-nlp/pull/288 and https://github.com/keras-team/keras-nlp/pull/360
We s…
-
### Describe the feature
Is there any support for pretraining configs for convnext-v2?
-
### Question
using script scripts/v1_5/pretrain.sh, I conducted llava pretraining using some task-specific image-text pair, now I am thinking of testing the pretrained model, and wondering how can …