search

CottageLabs / idfind

An identifier identifier
1 stars 0 forks source link

service URL-s: what to do on failure #37

Open emanuil-tolev opened 12 years ago

emanuil-tolev commented 12 years ago

What shall we do if:

  1. we are given a service URL when a test is submitted
  2. when somebody tries to identify an identifier, the test's regex matches
  3. but we get a 404 when we try that URL + their unknown identifier

Right now, this causes the test to "fail" (non-match) even though the regex succeeded. Should this be so?

Not only that, but if a test is submitted with a wrong service URL (e.g. non-existent URL because of typo) then that will cause the test to ALWAYS fail (it's counted as a non-match if any exceptions are raised during the service URL check).