w3c / ldp-testsuite

(UNMAINTAINED) Tests for Linked Data Platform (LDP)
Other
22 stars 29 forks source link

"Configuration Failures" not printed to the console #153

Closed spadgett closed 10 years ago

spadgett commented 10 years ago

Sometimes all tests are skipped due to "Configuration Failures." These are difficult to diagnose as no strack trace or error details are printed to the console and nothing helpful is in the HTML report.

===============================================
LDP Test Suite
Total tests run: 88, Failures: 0, Skips: 88
Configuration Failures: 2, Skips: 3
===============================================
spadgett commented 10 years ago

Against this particular server, the POST request is failing in

org.w3.ldp.testsuite.test.MemberResourceTest.setup(String, String, String, String, String)

Here's the error:

java.lang.AssertionError: 2 expectations failed.
Expected status code <201> doesn't match actual status code <403>.

Expected header "Location" was not not null, was "null". Headers are:
Access-Control-Allow-Credentials=true
Access-Control-Expose-Headers=User, Triples, Location, Link, Vary, Last-Modified
Access-Control-Max-Age=60
Link=<https://databox.me/,acl>; rel=acl
Ms-Author-Via=DAV, SPARQL
User=dns:99.39.214.161
Date=Wed, 20 Aug 2014 12:35:18 GMT
Content-Length=0
Content-Type=text/plain; charset=utf-8

Since it's an Error, not an Exception, the problem isn't caught and logged.