google-research / bigbird

Transformers for Longer Sequences
https://arxiv.org/abs/2007.14062
Apache License 2.0
563 stars 101 forks source link

Model for genomic sequences #36

Open Prachiiitd opened 9 months ago

Prachiiitd commented 9 months ago

Hi I could not find pretrained model for the genomic sequences task , neither I could find the script (training algo , tokenizer) which I could use to train my own model for the mlm task for genomic sequences.