data4development / IATI-data-validator

GNU Affero General Public License v3.0
5 stars 6 forks source link

Validating identifiers #59

Closed pelleaardema closed 3 years ago

pelleaardema commented 4 years ago

It is unclear how the validator checks identifiers: Looking at issue 47 (now closed), Rolf wrote:

_"To investigate... the system originally followed this hierarchy:

  1. if its an approved publisher id in the Registry, it's ok
  2. if not: if its on the organisation identifier codelist it's ok
  3. if not: if it doesn't start with an org-id prefix, provide this warning"_

However……there are a few issues here:

Solution: I would expect the validator to check for approved publisher ids

PetyaKangalova commented 4 years ago

Thanks @pelleaardema I am not sure I understand your last point. Could you clarify?

When I feed the validator non-existing identifiers (e.g. NL-XYZ-1234) it only gives a warning when this invalid value is present in , not when it's in

Are you using the upload functionality and adding a reporting-org/@ref that is for an organisation that is not registered with IATI. If so, could you add screenshot of the error?

pelleaardema commented 4 years ago

Hi @PetyaKangalova

Sorry, I used brackets which made the text disappear :-/

When I use a non-existing identifier (NL-XYZ-1234) in reporting-org, I get a warning (1.14.8 - The identifier does not start with a known prefix). This does not tell me if the check against existing identifiers took place.

I don't get that error message for the same identifier in 'participating-org'. Which I also would have expected --> that test appears to be missing.

rolfkleef commented 4 years ago

We'll investigate this again and add test cases and clarify the testing process further!

rolfkleef commented 4 years ago

I did a complete review of the identifier checks and added more test cases. Here is a table for now to document the checks and corresponding messages for all elements and attributes.

The new version still has to be deployed, the test scenarios for organisation identifiers and for activity identifiers are online.

rolfkleef commented 3 years ago

closing here