search

mlcommons / tiny

MLPerf™ Tiny is an ML benchmark suite for extremely low-power systems such as microcontrollers
https://mlcommons.org/en/groups/inference-tiny/
Apache License 2.0
355 stars 86 forks source link

Test harness mandatory? #165

Open gits00 opened 1 month ago

gits00 commented 1 month ago

Hello, My question is regarding the necessity of use of EnergyRunner Framework to run the benchmark. Looks like we need to implement the Test harness based on https://github.com/mlcommons/tiny/tree/master/. Is this a mandatory requirement? Alternatively, I may be able to use platformIO or some other native tool to download the code and run. Am I missing something? Thank you in advance

jeremy-syn commented 5 days ago

@gits00 I'm not sure I understand the question. In previous rounds, we've used the EEMBC runner, which can be obtained at https://www.eembc.org/energyrunner/mlperftiny/. We are currently implementing a new runner to replace it, which is in the runner subdirectory of the feature_new_runner branch. That new runner also requires an interface board, whose firmware is in the interface subdirectory of the same branch.