Fix: Change scraping logic for ICRC website

IFRCGo / go-api

MIT License

14 stars 6 forks source link

Fix: Change scraping logic for ICRC website #2288

Closed susilnem closed 2 weeks ago

susilnem commented 1 month ago

Addresses

https://github.com/IFRCGo/go-api/issues/2287

Changes

This PR is related to the command api/management/commands/ingest_icrc.py
Change the ingestion logic
Need to run the command python manage.py ingest_icrc

Checklist

Things that should succeed before merging.

[ ] Updated/ran unit tests
[ ] Updated CHANGELOG.md

Release

If there is a version update, make sure to tag the repository with the latest version.

szabozoltan69 commented 2 weeks ago

Should we merge this?

szabozoltan69 commented 2 weeks ago

Deployed to Staging

susilnem commented 2 weeks ago

hey @szabozoltan69 we also need to run this command python manage.py ingest_icrc

szabozoltan69 commented 2 weeks ago

Done:

~/go-api# python manage.py ingest_icrc
2024-11-04 15:00:22 INFO     Starting ICRC data ingest
2024-11-04 15:01:10 INFO     77 ICRC added
2024-11-04 15:01:10 WARNING  instance does not have an es_id() method