Define a Common Command Line Interface to run any container

Spirals-Team / benchmark-containers

A repository of benchmarks packaged as Docker containers

https://hub.docker.com/r/spirals

Apache License 2.0

18 stars 9 forks source link

Define a Common Command Line Interface to run any container #18

Open rouvoy opened 8 years ago

rouvoy commented 8 years ago

Instead of dealing with specific command line interfaces (CLIs), it would be relevant to define a standard CLI to run benchmark containers.

Such a CLI should include:

Introspection commands to list the benchmarks, workloads and other parameters (e.g., threads) available and their value.
Execution commands to run the benchmark with a specific workload and set of parameters.

This CLI should be exposed by all the available containers.

MensObscura commented 8 years ago

Hello,

Must i copy the run of NPB, and adapt it to all done benchmarks? Or make a new run ?

Currently the run of NPB contains :

  *a generic help.
  *The help of each benchmark.
  *And if the first param is not -help', it's assumed that the user want to run the benchmark.

So should we add a "-bench", a "-run" , or just continue with the same idea as NPB?

You are the final users, so you can choose or propose your favorite way. =)

rouvoy commented 8 years ago

You can take inspiration from NPB, but it is expected to have a new script with the same syntax (parameters, options) for all the containers of this project that will delegate to the specific script provided by the benchmark suite (whenever it exists and parameters/options can be mapped).