Closed oliverrahner closed 2 years ago
Hello,
I am really surprised about that, as I usually run several tests back to back on my local machine.
The only issue I've noticed is that if you interrupt the tests before their end, you'll have permission errors, as the test suite is running chmod 444
a lot of files and directories during the test to make them read-only. It even marks a bunch of directories as unusable with chmod 0
. The intention here is exactly to test that what you describe does not happen. Tests should not modify files out of their target directory in any way, and should not even read where it's not supposed to read. This is why I would appreciate if you could dig further on your side to see if you can understand what's going on.
By the way, if the permission issue occures to you, you want to use the little fix_perms.sh
script that is in charge of marking the files read/write again.
Thanks for reporting. I'm interested in the outcome of your exploration here.
So, the first-level cause is that I was maybe running the tests as root... eh... hehe... yeah. When I run it as a regular user, the previously failing test cases pass.
That still leaves us to guess what the root cause is, but I don't have more time to spend on this unfortunately. To be honest, the whole stuff with reducing permissions during the test cases feels kinda hacky.
I will continue creating testcases for my PR.
While preparing test cases for #331, after running the testsuite using
./Build test
on the current master, I noticed that some of the template files that the output files are checked against are deleted during the run. As that makes the test cases not repeatable, I guess this is not the intended behavior?The test summary:
git status
: