CGAL / cgal

The public CGAL repository, see the README below
https://github.com/CGAL/cgal#readme
Other
4.87k stars 1.38k forks source link

Testsuite improvements #2205

Open MaelRL opened 7 years ago

MaelRL commented 7 years ago

This issue is about improvement ideas to the way we test code:

### Tasks
- [ ] https://github.com/CGAL/cgal/issues/8165
- [ ] https://github.com/CGAL/cgal/issues/8166
- [ ] https://github.com/CGAL/cgal/issues/8167
- [x] The "y" square at the top of the "y" column is missing the green color (fixed by #7314)
- [x] Distinguish between error and time-out
- [x] Show run time for each executable
- [ ] https://github.com/CGAL/cgal/issues/8162
- [ ] https://github.com/CGAL/cgal/issues/8425
- [ ] https://github.com/CGAL/cgal/issues/8424
- [ ] https://github.com/CGAL/cgal/issues/8423
- [x] CAN NOT BE IMPLEMENTED. Compare runtimes of each executable over consecutive runtime testsuites and report large swings (~thus creating some kind of benchmarking tests). Could be a "S" letter (for Speed), yellow (and put warnings to orange).
- [ ] https://github.com/CGAL/cgal/issues/8164
- [ ] https://github.com/CGAL/cgal/issues/8426
MaelRL commented 6 years ago

<-- Moved to main post -->

maxGimeno commented 5 years ago

The diff tool can be found here