search

kssteven418 / LTP

[KDD'22] Learned Token Pruning for Transformers
https://arxiv.org/abs/2107.00910
Apache License 2.0
93 stars 17 forks source link

FLOPs #6

Open Cydia2018 opened 2 years ago

Cydia2018 commented 2 years ago

Since it is a dynamic transformer, the GFLOPs of each instance input is different. How to calculate the FLOPs of the entire model? Take the average FLOPs of all validation sets?

kssteven418 commented 2 years ago

Yes, the current implementation counts the averaged FLOPs across all the examples in the validation set

Cydia2018 commented 2 years ago

Yes, the current implementation counts the averaged FLOPs across all the examples in the validation set

Thanks for your reply!