hendraet commented 2 years ago

General info

[x] Conference: ICPR 2022
[x] Submission date: 05.01.2022
[x] Papers title: Synthesis in Style: Semantic Segmentation of Historical Documents using Synthetic Data
[x] Source paper: https://arxiv.org/pdf/2107.06777.pdf
[x] GitHub repo: https://github.com/hendraet/synthesis-in-style
[x] Platform: Ubuntu 20.04
[x] Language: Python3
[ ] Results that can be reproduced: Tables I - III, Figure 3 (Supplementary Material: Tables IV-VI, Figures 4-7)
[x] Reproduction main step instructions: README

Reviewer feedback

Execution without errors:
- [ ] without changes
- [ ] with small changes
- [ ] with a lot of changes
Results are obtained:
- [ ] always
- [ ] sometimes
- [ ] never
Results correspond to the paper's figures/tables:
- [ ] exactly
- [ ] with negligible differences
- [ ] with differences
- [ ] with a lot of differences

Cyril-Meyer commented 2 years ago

[x] Tested platform: Ubuntu 18.04.6 LTS (GNU/Linux 5.4.0-110-generic x86_64) | Docker version 20.10.16, build aa7e414 | NVIDIA GeForce RTX 2080 Ti
[x] Result reproduced: Tables I - III, Figure 3 (Supplementary Material: Tables IV-VI, Figures 4-7)
[x] Reviewer comment: The figures and tables have been reproduced using the trained models provided. No training has been done by the reviewer yet, the author will provide StyleGAN model because original dataset is not publicly available. Detailed steps here Cyril-Meyer/RLPR-synthesis-in-style

Execution without errors:
- [x] without changes
- [ ] with small changes
- [ ] with a lot of changes
Results are obtained:
- [x] always
- [ ] sometimes
- [x] never : can not reproduce training
Results correspond to the paper's figures/tables:
- [x] exactly
- [ ] with negligible differences
- [x] with differences : Tables contains error, authors will correct them in the final version of the paper.
- [ ] with a lot of differences