search

Lupin1998 / VQDNA

[ICML 2024] VQDNA: Unleashing the Power of Vector Quantization for Multi-Species Genomic Sequence Modeling
https://arxiv.org/abs/2405.10812
Apache License 2.0
7 stars 1 forks source link

Request about Model Arch Details #2

Open xk-huang opened 2 days ago

xk-huang commented 2 days ago

Hi, @Lupin1998

Thanks for the awesome work!

I am curious about the model architecture details in the model, esp. the convnet:

  1. Are there any down-sampling conv like ConvNext? If there is no down-sampling, the output tensor should have size up to (32,000, 512), which is huge. Will that become a problem?
  2. Is the model isotropic that each layer outputs the same number of channels?

I tried my best but could not find any details about it.

Thanks!

ychuest commented 2 days ago

It hasn't been successfully reproduced yet.