search

LeapLabTHU / FLatten-Transformer

Official repository of FLatten Transformer (ICCV2023)
377 stars 21 forks source link

Request for DeiT-Tiny model definition. #12

Closed hankyul2 closed 10 months ago

hankyul2 commented 10 months ago

Hi @tian-qing001

First, thank you for sharing your wonderful work as an open source. I appreciate your work.

Question: Can you share the flatten transformer implementation applied on the DeiT-T model?

I am trying to reproduce table 3 of the paper (shown in the below figure). If you could provide the implementation of your method on DeiT-T, it would help me a lot. image

Thank you.

Hankyul.

tian-qing001 commented 10 months ago

Hi @hankyul2, we sincerely appreciate your attention to our work. To access the script for the FLatten-DeiT-T model, please refer to this resource. It is worth pointing out that FLatten-DeiT-T was initially trained using a different code base. We plan to integrate it into this repository in the near future.

hankyul2 commented 10 months ago

Thank you for your quick reply. It helps me to grasp how to implement your method on the DeiT-T model.

Thank you.

Hankyul.