-
I am using the run_mlm.py with bert_layers.py. When I run run_mlm.py, I encountered an error: Ask me to install Transformer with version more than 4.42.0.dev0. Since the version in requirement.txt is …
-
Hi, I tried to install the model without triton (which was reported in previous issues), and I received such an error:
```
assert q.is_cuda and k.is_cuda and v.is_cuda
```
Would you please sha…
-
```
export DATA_PATH=/data5/chenruipu/data/wangchao/train_data # e.g., ./sample_data
export MAX_LENGTH=1872 # Please set the number as 0.25 * your sequence length.
# e.g., set it as 25…
-
Hi, I am really excited about this newest DNABERT model and it's application on my project, but when I am trying to run on my computer, I encountered some issues
My environment:
# packages in enviro…
-
Hello Dr. ZHOU(@Zhihan1996),
For the random problem, I found the problem still exists for same DNA sequence if I reload the model by running the first code cell. For instance, If I run the second c…
-
Hello Dr. Zhihan, hope you are doing well.
I have implemented your amazing pre-trained model for dna sequence tokenization and it works great!
Meanwhile, I have noticed you have mentioned the mode…
-
I'm wondering if other users are also experiencing this situation: when I try to convert the same DNA sequence into a tensor multiple times using DNABERT2, the hidden state converted several times in …
-
I wanted to get embeddings for longer sequences (which can be >20kb). I can segment sequences and get embeddings for each segment. Do you have an idea of how to combine embeddings of segments to give …
-
### Model description
I want to add a new model for RNA sequence modeling in next few weeks, like DNABERT. I have drafted a branch [here](https://github.com/yangheng95/transformers/tree/add_omnigenom…
-
Hello,
Thank you for providing a great language model that can be applied to metagenome sequences. I wanted to try classification and binning but from the readme description, it is unclear how …