Using CNN layers replace transformer

shariqfarooq123 / AdaBins

Official implementation of Adabins: Depth Estimation using adaptive bins

GNU General Public License v3.0

725 stars 156 forks source link

Using CNN layers replace transformer #43

Closed suyuzhang closed 2 years ago

suyuzhang commented 3 years ago

Hi @shariqfarooq123, Thanks for your work! I have a question. Have you tried to use the CNN to replace the transformer?

shariqfarooq123 commented 2 years ago

We tried using global pool + MLP to estimate the adaptive bins (both at the bottleneck as well as the final decoder layer) but that didn't work as well as the transformer.