search

rahulpandita / APISIM

1 stars 1 forks source link

Experiment Design Description #3

Open rahulpandita opened 9 years ago

rahulpandita commented 9 years ago

The experimental design - especially the comparison to the previous approaches needs to be clarified. For example, it isn't clear to me whether the comparison against the earlier approaches is made by using the same datasets or by rerunning techniques using the existing tools. This is another example of lack of rigor in the explanation of the experiment.

rahulpandita commented 9 years ago

Rosetta returns exact mappings - whereas TMAP returns a list of ranked APIs. Making a direct comparison of top 10 vs. exact mappings is really not a fair comparison. The analysis needs to be thought through more carefully.