search

mlcommons / mlperf-automations

This repository contains the automations and scripts used to automate MLPerf benchmarks (mainly MLPerf inference for now)
http://docs.mlcommons.org/mlperf-automations/
Apache License 2.0
0 stars 2 forks source link

Running mlperf inference benchmarks on systems without internet connectivity #38

Open arjunsuresh opened 1 year ago

arjunsuresh commented 1 year ago

Some edge systems may not be connected to internet and we need a way to run mlperf inference benchmarks on them using CM.

gfursin commented 10 months ago

I believe many of our CM automation recipes can plug in models and data sets locally, right?

arjunsuresh commented 10 months ago

yes Grigori. But this issue is for running MLPerf inference on systems without internet and there even pip install will fail. So, we probably need to do the preparation on a host machine and then do the final run on the target. Nvidia does this for their Jetson Orin submission and not having internet improves the power efficiency :)