search

mlcommons / mobile_models

MLPerf™ Mobile models
https://mlcommons.org/en/groups/inference-mobile/
Apache License 2.0
24 stars 10 forks source link

snusr_lr.zip should contain all 25 test images #54

Closed fatihcakirs closed 1 year ago

fatihcakirs commented 1 year ago

https://github.com/mlcommons/mobile_models/blob/main/v3_0/datasets/snusr_lr.zip is only ~25 MB and thus should contain all the 25 test images (snusr_lr_full.zip).

This dataset is used in the performance run (as shown in the tasks.pbtxt file) hence no need to limit based on the HR version.

anhappdev commented 1 year ago

The number of images in the input_path needs to be matched with the number of images in the groundtruth_path else the app will crash with

libc++abi: terminating with uncaught exception of type std::out_of_range: vector
* thread #27, name = 'DartWorker', stop reason = signal SIGABRT
    frame #0: 0x00000001eedeb160 libsystem_kernel.dylib`__pthread_kill + 8
libsystem_kernel.dylib`:
->  0x1eedeb160 <+8>:  b.lo   0x1eedeb180               ; <+40>
    0x1eedeb164 <+12>: pacibsp 
    0x1eedeb168 <+16>: stp    x29, x30, [sp, #-0x10]!
    0x1eedeb16c <+20>: mov    x29, sp
Target 0: (Runner) stopped.

I think this is the reason: https://github.com/mlcommons/mobile_app_open/issues/601