A novel pattern-based edit distance for automatic log parsing: Implementation and reproducibility notes

[raynalm]

General info

• [ ] Conference: ICPR 2022 - RRPR 2022
• [ ] Submission date: 1st July 2022
• [ ] Papers title: ICPR: A novel pattern-based edit distance for automatic log parsing - RRPR: A novel pattern-based edit distance for automatic log parsing: Implementation and reproducibility notes
• [ ] Source paper: paper ICPR paper RRPR
• [ ] GitHub repo: https://github.com/nokia/pattern-clustering/
• [ ] Platform: Ubuntu 20.04 LTS
• [ ] Language: C++ and Python 3 - jupyter notebook
• [ ] Results that can be reproduced: (indicates references to figures/tables of your paper): ICPR paper figures 4, 5, 6
• [ ] Reproduction main step instructions: follow the steps described in the installation wiki and run the jupyter notebook full_experiments.ipynb

Reviewer feedback

• [ ] Tested platform:
• [ ] Result reproduced:
• [ ] Reviewer comment:

Details Results

• Execution without errors:
  • [ ] without changes
  • [ ] with small changes
  • [ ] with a lot of changes
• Results are obtained:
  • [ ] always
  • [ ] sometimes
  • [ ] never
• Results correspond to the paper's figures/tables:
  • [ ] exactly
  • [ ] with negligible differences
  • [ ] with differences
  • [ ] with a lot of differences

[akrah]

Thanks for your submission. @elnrdfrs will start the review after July 13.

[elnrdfrs]

Hello, I successfully installed the pattern-clustering tools and the necessary datasets and was able to run the minimal.ipynb and full_experiments.ipynb notebooks. I have a couple of questions:

• In full_experiments.ipynb, for the minimal and specific datasets experiments, the output filenames are the same ; was it intentional?
• The notebooks produce the .json file containing the results but do not directly display the figures meant to be reproduced ; is there a straightforward way to recreate the figures of your paper from these output files? By reading the wiki, I figured that there is a way to produce a html file after processing the log files, but not from the output json files. Thank you in advance for your help. Eléonore