TriHuynh00 / AC3R-Demo

Automatic Crash Constructor from Crash Report (A3CR) Demo of constructing simulations from crash reports
11 stars 6 forks source link

Study replicability of results #31

Closed alessiogambi closed 3 years ago

alessiogambi commented 3 years ago

The results produced by the simulation of an individual/scenario should be the same or at least comparable.

We need to study if this is the case and how much the results change. To do so we can update the evaluate function to take two additional parameters: n_repetitions -> how many times the same simulation must be repeated aggregate_function -> how to aggregate the results (for example, we can use np.mean, or min/max)