instadeepai / nucleotide-transformer

🧬 Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human Genomics
https://www.biorxiv.org/content/10.1101/2023.01.11.523679v2
Other
469 stars 55 forks source link

SegmentNT with a frozen encoder? #78

Open Azai-yx opened 2 months ago

Azai-yx commented 2 months ago

Hi,

Recently, I tried to implement a couple of downstream tasks where the data might not be sufficient to fine-tune the Nucleotide Transformer. However, with the release of SegmentNT, I wonder if you have ever tried tuning only the U-Net for downstream tasks?