search

ConSol-Lab / gourd

a command-line tool for configuring, running, and analysing algorithm comparison experiments on supercomputers
4 stars 0 forks source link

Grouping of outputs #9

Closed andtsa closed 3 months ago

andtsa commented 4 months ago

Current:

For program fast-fibonacci:
   0. bad_test.... failed, code: 25856
   1. test_2...... success, took: 683ms 968us 708ns
   2. test_35..... success, took: 684ms 593us 125ns
   3. test_8...... success, took: 686ms 249us 750ns

For program fastest-fibonacci:
   4. bad_test.... failed, code: 25856
   5. test_2...... success, took: 647ms 668us 791ns
   6. test_35..... success, took: 649ms 990us 542ns
   7. test_8...... success, took: 650ms 557us 792ns

Desired:

For Small Problem Set:
   For program fast-fibonacci:
      0. bad_test.... failed, code: 25856
      1. test_2...... success, took: 683ms 968us 708ns
   For program fastest-fibonacci:
      4. bad_test.... failed, code: 25856
      5. test_2...... success, took: 647ms 668us 791ns 

For Big Problem Set:
   For program fast-fibonacci:
      2. test_35..... success, took: 684ms 593us 125ns
      3. test_8...... success, took: 686ms 249us 750ns

   For program fastest-fibonacci:
      6. test_35..... success, took: 649ms 990us 542ns
      7. test_8...... success, took: 650ms 557us 792ns

or with flag --side-by-side (this will lead to extra lines of repetitive output, not helpful in case of e.g. one algorithm)

For Small Problem Set:
   bad_test:
       fast-fibonacci:     failed, code: 25856
       fastest-fibonacci:  failed, code: 25856
   test_2:
       fast-fibonacci:     success, took: 683ms 968us 708ns
       fastest-fibonacci:  success, took: 647ms 668us 791ns 

For Big Problem Set:
   test_35:
       fast-fibonacci:     success, took: 684ms 593us 125ns
       fastest-fibonacci:  success, took: 649ms 990us 542ns
   test_8:
       fast-fibonacci:     success, took: 686ms 249us 750ns
       fastest-fibonacci:  success, took: 650ms 557us 792ns
andtsa commented 4 months ago

From correspondence this is the initial requirement, implementation details to be discussed.