-
Hi, I wonder if it is possible to pretrain this model with different sequences (different fa file from different species). I find there are short descriptions but no instructions in the readme file. C…
-
First of all , been following you on huggingface for quite some time now and your work is really amazing
After pruning the model will not generate coherent text for sure and we have to heal them…
-
Can you provide the pre-trained weights for this model? Thank you!
-
I tried to train and evaluate based on this script:
[RetroMAE/examples/retriever/msmarco at master · staoxiao/RetroMAE](https://github.com/staoxiao/RetroMAE/tree/master/examples/retriever/msmarco)
T…
-
I have two questions: how was the data preprocessing handled? What is the optimisation algorithm used for model training(Or what the optimiser chose
)?
-
Hello @tomaarsen,
I hope u are doing well. I love the new Sentence Transfomers release!
I am writing to propose a few feature requests that I believe would enhance Sentence Transformers:
- Add …
-
I tried to reproduce the pre-training experiment using the command
```
python -m train experiment=hg38/hg38 callbacks.model_checkpoint_every_n_steps.every_n_train_steps=500 dataset.max_length…
-
### Describe the issue
Issue:
Command:
```
resuming training from pre-tained model (sudden quit)
```
Log:
```
Last 10 lines of StdErr:
File "/train/train_mem.py", line 13, in
t…
-
When using pre-trained weights for training, an error is reported “optimizer_D_state_dict miss”,Please tell me how to solve this problemPlease tell me how to solve this problem
![image](https://git…
-
Hi~.Could you please provide the pre-training dataset? Thank you very much.