API endpoint /api/action/organization_list frequently times out

[simon-20]

Brief Description The API endpoint /api/action/organization_list can be called with various parameters, or none.

As parameters are specified to include more information, the request time takes longer and longer.

With all_fields=true it takes around ~20 seconds.

With all_fields=true&include_extras=true it routinely takes 30+ seconds.

If you try to fetch all the available data, e.g., with:

http "https://iatiregistry.org/api/action/organization_list?all_fields=true&include_extras=true&include_tags=true&include_groups=true&include_users=true"

the request very often times out:

504 Gateway Time-out
nginx/1.24.0

Severity Medium

Issue Location

https://iatiregistry.org/api/action/organization_list?all_fields=true&include_extras=true&include_tags=true&include_groups=true&include_users=true

Steps to Reproduce

Try to fetch the list of organisations with all the data possible.

[siwhitehouse]

Thanks @simon-20 - I was able to reproduce the 504 error immediately.

@robredpath I think this is another issue for the future, unless you think it should have a high priority.

[robredpath]

@simon-20 if I use paging (using limit and offset) then I get responses quite quickly - is that a suitable workaround for your current work?