pwyf / 2018-index-indicator-definitions

1 stars 0 forks source link

Results #34

Open andylolz opened 7 years ago

andylolz commented 7 years ago

Description

The results show whether activities achieved their intended outputs in accordance with the stated goals or plans.

This is only expected if the activity is in the implementation, completion or post-completion phase.

This is not expected if the sector code is administrative costs (91010).

Proposed tests

Firstly (results data):

For each current activity,
if `activity-status/@code` is one of (2, 3, 4)
and `sector/@code` is not 91010
then `result` should be present

Secondly (results documents):

For each current activity,
if `activity-status/@code` is one of (2, 3, 4)
and `sector/@code` is not 91010
then `document-link/category[@code="A08"]` should be present
breidertmt commented 7 years ago

what happens if A08 docuements are present, but result is not at each activity? Results do not always come in at that granular level.

FMadsen commented 7 years ago

What about Results Data?

andylolz commented 7 years ago

Hi @FMadsen. The second test checks results documents; The first test checks results data. I’ve amended the test description to make this explicit. Thanks

andylolz commented 7 years ago

what happens if A08 docuements are present, but result is not at each activity? Results do not always come in at that granular level.

Hi @breidertmt. Are you able to provide an example where this is the case? It would be great to take a look at something specific.

olehjo commented 7 years ago

I wonder whether the sector code is the best choice of a dimension, where you could filter out Activities that wouldn’t have ‘results’. I do understand why you have pointed out 91010, but instead of ‘sector’ you could capture this as type_of_aid G01.

Using type_od_aid would make it simpler to identify other modalities where it would be nonsense for donors to claim results. Obviously H02 (sector 93010), but I would also suggest to disregard well-aligned modalities like A01 and A02, B01 and B02. Here it makes no sense for donors to claim that their contribution has yielded specific results – this must be left to the recipient to report.

I would expect E02, F01 and H01 to be without developmental results as well, since there is no cross-border flow.

francescafo commented 7 years ago

Sometimes information on programmes/project is published although the action is not in implementation or no result data collection has been done yet. How to show this and not be penalised only because results are not available yet?

andylolz commented 7 years ago

@olehjo Thanks for this. We’re interested in exploring your suggestion of using Aid Type G01 instead of sector code 91010. We intend to discuss this in more detail with @wendyrogers.

andylolz commented 7 years ago

@francescafo: If the activity is not yet in implementation then the activity is ignored by these tests. If the activity is ongoing, though, then baseline and expected results should be available.

wendyrogers commented 7 years ago

Thanks for flagging @andylolz and I would agree with @olehjo that Aid Type might provide a better test here than using specific sector codes. However happy to discuss as suggested

ToonVB commented 7 years ago

Agree with @olehjo : in fact it's only regarding C01 projects that results info is meaningful / useful (ànd available).

andylolz commented 7 years ago

Thanks for all the comments here.

Based on feedback elsewhere, we will modify this test to ignore default-aid-type/@code G01, rather than sector code 91010.