search

JDAI-CV / dabnn

dabnn is an accelerated binary neural networks inference framework for mobile platform
Other
769 stars 102 forks source link

Benchmark guide #62

Open Bil17t opened 5 years ago

Bil17t commented 5 years ago

First, congrats on such a successful framework! I would like to test the speed of daBNN on my platform. I can see the benchmark utility, but does it include actual inference on imagenet pictures? Any more detailed instruction?

daquexian commented 5 years ago

Thanks for your attention!

You might want to check out https://github.com/JDAI-CV/dabnn-example . I'll also add some detailed document soon.

On Thu, Oct 17, 2019, 10:56 PM Bil17t notifications@github.com wrote:

First, congrats on such a successful framework! I would like to test the speed of daBNN on my platform. I can see the benchmark utility, but does it include actual inference on imagenet pictures? Any more detailed instruction?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/JDAI-CV/dabnn/issues/62?email_source=notifications&email_token=ACYRZH57JOACKFETACHJ7BTQPB4LLA5CNFSM4JB24ZN2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4HSPT4EA, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACYRZHZMQZWCT4H6WERAQJTQPB4LLANCNFSM4JB24ZNQ .

daquexian commented 5 years ago

Which do you want to do, benchmark some models on your side, or do actual inference? Thanks!

Bil17t commented 5 years ago

I have tested the speed. It would be better if we can verify the accuracy as well. It will also be easier to deploy other models.

daquexian commented 5 years ago

For verifying the accuracy, I think you can modify the code based on https://github.com/JDAI-CV/dabnn-example and check the output currently.

daquexian commented 5 years ago

And if you want to verify the accuracy more carefully, you can check out 'binaries/run.cpp' about how to send a given input tensor to the model and retrieve the output.