search

IATI / D-Portal

http://d-portal.org/
Other
31 stars 23 forks source link

No data for FAO #603

Closed sarahshamiso closed 4 months ago

sarahshamiso commented 3 years ago

If you search for FAO under Publisher, there are no results. The files seems to be downloading according the Dashboard so just wondering what the issue might be here?

image

xriss commented 3 years ago

HTTPS problems, looks like a badly configured server using ( what are now considered ) insecure keys. You can see the error by trying to fetch the file using curl like so.

curl https://sdlc.fao.org/artifactory/fao-iati-releases/Activities.xml

curl: (35) error:141A318A:SSL routines:tls_process_ske_dhe:dh key too small

I think we can tweak some settings so that this gets ignored, but it is a problem with the publishers server configuration.

sarahshamiso commented 3 years ago

Thanks for the explanation! @PetyaKangalova maybe something to flag to FAO?

PetyaKangalova commented 3 years ago

Thanks all! @amy-silcock as you emailed FAO last week about validation, can you follow up on your email and flag the server issues as well?

notshi commented 3 years ago

Just fyi, we have adjusted our end to ignore curl ssl errors so FAO should now be filled with data.

notshi commented 3 years ago

Hello, any updates on this?

amy-silcock commented 3 years ago

The dev team at FAO have been notified. We sent a 2 week reminder email today asking for an update but haven't heard anything back.

notshi commented 3 years ago

Thanks, @amy-silcock - hope they respond soon.

notshi commented 2 years ago

Hi, just wondering if FAO have responded and we can close this?

PetyaKangalova commented 2 years ago

@notshi Amy is on leave. I just checked and the latest response we had was back in March that their developers will be addressing the issue, but not a confirmation it has been done. However, I can see all activities are present on d-portal: http://d-portal.org/ctrack.html#view=search&reporting_ref=XM-DAC-41301

Is there still an issue? If so, I will follow-up.

notshi commented 2 years ago

Hi @PetyaKangalova, thanks for taking a look at this.

The issue is with the FAO as their server has HTTPS problems where they are using insecure keys.

On our end, we're now ignoring curl ssl errors so we can access their data.

I was under the impression that the issue was kept open to make sure they fixed their end so that other data users will benefit from this fix and to close this issue when that happens.

PetyaKangalova commented 2 years ago

Hi @notshi ! Okay, I understand now! Let me follow-up with them and get back to you!

stevieflow commented 4 months ago

This is resolved

https://d-portal.org/ctrack.html#view=search&reporting_ref=XM-DAC-41301 populates

and

https://iatiregistry.org/publisher/fao does not cite the http error. There is a separate issue in terms of the file size for FAO, but that does not affect the loading into d-portal

Therefore closing this