search

JuliaReach / ARCH2020_NLN_RE

Repeatability Evaluation package for the ARCH2020 NLN Competition
3 stars 0 forks source link

Add CSV output #3

Closed mforets closed 4 years ago

mforets commented 4 years ago 
<nameOfTool>\n
<string: BenchmarkID>;<bool: verified>;<double: computationTime>\n
<string: BenchmarkID>;<bool: verified>;<double: computationTime> \n
"End of "<nameOfTool> \n\n #this is just a sanity check

Example:

CORA\n
ISSF01ISU01; 1; 201.33 \n
ISSC01ISS01; 1; 50.54 \n
End of CORA
mforets commented 4 years ago

The following code:

casos = ["W1", "W2", "W3"]
verified = [1, 1, 1]
runtimes = [1.0 , 2.0, 3.0]

open("test.csv", "w") do io
   print(io, "JuliaReach\n")
   for (i, c) in enumerate(casos)
        print(io, "$c; $(verified[i]); $(runtimes[i])\n")
   end
   print(io, "End of JuliaReach")
end

generates

JuliaReach
W1; 1; 1.0
W2; 1; 2.0
W3; 1; 3.0
End of JuliaReach
mforets commented 4 years ago

Comma to separate values and point as a decimal seperator

Regarding tool name, benchmark ID and instance:

Tentative decision: , , <instance (possibly empty)>, <verified (0/1)>,

mforets commented 4 years ago

The final format is:

PRD20: Production-Destruction
CVDP20: Couple Van der Pol
LALO20: Laub-Loomis
QUAD20: Quadrotor
LOVO20: Lotka-Volterra
SPRE20: Space Rendezvous

Tool, PRDE20, I, 1, runtime, final volume

Tool, PRDE20, P, 1, runtime, final volume

Tool, PRDE20, IP, 1, runtime, final volume

Tool, CVDP20, mu1, 1, runtime

Tool, CVDP20, mu2, 1, runtime

Tool, LALO20, W001, 1, runtime, final width

Tool, LALO20, W005, 1, runtime, final width

Tool, LALO20, W01, 1, runtime, final width

Tool, QUAD20, delta01, 1, runtime

Tool, QUAD20, delta04, 1, runtime

Tool, QUAD20, delta08, 1, runtime

Tool, LOVO20, , 1, runtime, volume, cntmax

Tool, SPRE20, , 1, runtime

I can take care of this task, hopefully this afternoon.