search

SAIN-Project / Frontend

0 stars 0 forks source link

ICSA Hadoop Experiment - Error Before Completion #22

Open jgarci40 opened 3 years ago

jgarci40 commented 3 years ago

For the ICSA Hadoop experiment, I get the following error every time I try to run it.

First part of error: Screen Shot 2021-03-13 at 8 05 32 PM

Second part of error: Screen Shot 2021-03-13 at 8 05 50 PM

khoiminhpham commented 3 years ago

This is solved Sempai @jgarci40, we can re-try it in ready-to-run experiment (ICSA 2021), it'll be time consuming in HDSM (5 mins) and Tactic RootCover (25 mins), but if we can wait until the end (around 30 mins), we'll see all expectation outputs.

ps: if you can cc Yutong to this issue it'd be helpful Sempai.

TarandeepSingh562 commented 3 years ago

The bug seems to be fixed. Ran and tested ICSA 2021 experiment a couple of times. Took about 1 hour and 45 minutes to complete each time and found no errors when doing so. However, I should note that the sample ICSA 2021 experiment results from the main website were not the same as the results as the written ICSA 2021 research paper. Some of the values in the .csv were the same as the rank of each tactic leading file for fixing bugs, but the characteristics of the Tactic-ArchRoots (DSB & BSC percentages), frequency, and all Tactic-ArchRoots percentages were different.

jgarci40 commented 3 years ago

Hi @TarandeepSingh562. This appears to be an issue resulting from the fact that the paper experiments use Understand, a proprietary piece of software to extract facts from Hadoop, which we can't release on SAIN. We have to use open-source software, at least for now. I'll reach out to @TarandeepSingh562, @khoiminhpham, Yutong, and Lu over Slack to decide whether it's OK to close this issue.