openid-certification / oidctest

THE CERTIFICATION TEST SUITE HAS BEEN MIGRATED TO A NEW SERVICE https://www.certificatinon.openid.net
Other
49 stars 15 forks source link

Wrong tests logs placement #228

Closed Deivur closed 4 years ago

Deivur commented 4 years ago

Today figured out that test log could be placed in the wrong path. As the documentation says https://openid.net/certification/rp_testing/ we expect to see logs here https://rp.certification.openid.net:8080/log/mod_auth_openidc. But now they duplicated in the one more place https://rp.certification.openid.net:8080/log/log/mod_auth_openidc Here are screenshots: base folder

Screen Shot 2020-06-12 at 17 45 57

nested folder

Screen Shot 2020-06-12 at 17 46 49

I have automated tests and they fail from time to time as can not retrieve log to verify state and they can't clean up logs after the end. Is it an issue? Or it is expected and I need to handle such behavior? Thanks, in advance!

zandbelt commented 4 years ago

That is unexpected indeed, it looks like at some point a bug was introduced in log placement; can you also test this against https://new-rp.certification.openid.net:8080? Also, you seem to indicate that this misplacement is intermittent, is it?

Deivur commented 4 years ago

@zandbelt thank you for the quick answer, I'll try today and get back to you with the result.

zandbelt commented 4 years ago

it seems that the server process got into a bad state: after a restart things seem to back to normal, please confirm

Deivur commented 4 years ago

Apologies for the long answer. With new endpoint https://new-rp.certification.openid.net:8080 looks everything good. Will this URL change in the future? I ran tests locally with old endpoint https://rp.certification.openid.net:8080 and they passed as well.

zandbelt commented 4 years ago

please keep using https://rp.certification.openid.net:8080 for now