-
Thank you for publishing DNABert2.
I found that the feature lengths obtained by inputting multiple sequences of the same length into DNABert2 are not the same.I would like to know if you have encount…
-
Thank you for your work. I want to know the specific processes for pre-training. I can run the following code from https://github.com/huggingface/transformers/tree/main/examples/pytorch/language-mode…
-
Epoch [1/3]
---------------------------------------------------------------------------
KeyError Traceback (most recent call last)
File :21, in _fwd_kernel(Q, K, V,…
-
I'm following your example https://github.com/jerryji1993/DNABERT#22-model-training. I did not use apex as I am unable to compile it under the python3.6 environment. Otherwise, I've exactly followed t…
-
What is the problem and the solution??
The provided data_path is /home/shiro/DNABERT_2/finetune
2023-08-31 17:57:18.856636: W tensorflow/stream_executor/platform/default/dso_loader.cc:59] Could no…
-
Hi,
Very simple issue, this error:
"ValueError: loaded state dict contains a parameter group that doesn't match the size of optimizer's group"
Is displayed when I'm trying to load a a pre-trained m…
-
```shell
atrix@Atrix:/mnt/c/Users/adity/OneDrive/Desktop/dnabert/DNABERT_2-main/finetune/Scripts$ sh run_dnabert2_new.sh /mnt/c/Users/adity/OneDrive/Desktop/dnabert/GUE
The provided data_path is /mn…
-
# code: the readme demo
```python
import torch
from longformer.longformer import Longformer, LongformerConfig
from longformer.sliding_chunks import pad_to_window_size
from transformers import Ro…
-
Hello,
I tried finetuning the 6-mer model with the provided example data. Performance seems to be good at first, but then it suddenly drops significantly raising a warning. First few evaluations s…
-
Hi @Moeinh77 I have tried to run the code with my data but it is giving me certain errors like num classes are not defined, sequences are not defined. Can you please tell me exactly how to use it for …