search

mit-han-lab / hardware-aware-transformers

[ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
https://hat.mit.edu
Other
329 stars 50 forks source link

Question about the latency on Raspberry Pi #15

Closed qaz12994 closed 2 years ago

qaz12994 commented 2 years ago

Dear Authors,

Hi, thanks for the library! I tested it successfully on my GPU, but the problem I am having now is that the latency of the raspberry pi I'm used is different with yours. I used WMT'14 En-Fr for testing, and below is the instruction for my delay and test: wmt_enfr_latency

I'm not sure what the problem is, do I need additional settings? And this is my environment:

Thanks.

qaz12994 commented 2 years ago

I found how to optimize, thanks!