search

MAGICS-LAB / DNABERT_2

[ICLR 2024] DNABERT-2: Efficient Foundation Model and Benchmark for Multi-Species Genome
Apache License 2.0
212 stars 49 forks source link

Cannot Reproduce DNA-BERT2‘s Result #86

Closed KatarinaYuan closed 1 month ago

KatarinaYuan commented 1 month ago

Hi, I try to run the command in ./DNABERT_2/finetune/scripts/run_dnabert2.sh and get the following results. However, it cannot match the reported ones in DNA-BERT2's paper.

Screen Shot 2024-05-07 at 10 44 19 PM

Zhihan1996 commented 1 month ago

Can you specify the hyperparameters you are using? For example, this scripts expect 4 GPUs for a suitable batch size and training steps.