-
Is there anywhere a BERT-base monolingual French pre-trained model?
I need it as entry for fine-tuning Question & Answering in French.
-
There is an error in the script for fine tuning the bert baseline:
`--train_precomputed=nq-train.tfrecords-00000-of-00001 \` should be
`--train_precomputed_file=bert-joint-baseline/nq-train.tfrecord…
-
My corpous consists of pure numbers like 1, 2, ..., 1000000, ..., 1002342, ....
It is differen from words in any language.
Can I replace the vocab.txt with my own vocab.tx created using my corpous f…
-
Hi,
As this model is fine-tuned on a pretrained reimplementation of BERT. Can anyone please share model weights generated after this fine tuning experiment.
Thanks in advance!
-
Hi, BangLiu,
I use Bert to fine-tuning, extract two long document pair first 256 words, feed them bert, output is feed classifcation layer;
My model batch_size is 6, epoch 2; but the result …
-
As per the standard for PPO Training (which is to do supervised-fine tuning before running the PPO Algorithm) I did a QLoRa fine-tuning of the Llama-3-8B instruct model using my own custom data and th…
-
I am fine-tuning the BERT model but need to add a few thousand words. I know that one can replace the ~1000 [unused#] lines at the top of the vocab.txt, but I also notice there are thousands of single…
-
I have some traditional features, such as the length of the sentence, the number of nouns in the sentence. How do I combine these features with bert for fine-tuning?
-
Hi,
first, thank u for having sharing ur cod with us
I am trying to further pretraining a bert model on my own corpus on colab gpu but I am getting an error of resource exhausted
can someone te…
-
Hi,
In your paper, does the model edited in ROME or MEND methods must be fine-tuned?
How to apply the ROME to the model without fine-tuning ?
For example, the bert model is not just the GPTs serie…