search

ckan / ckanext-xloader

Express Loader - quickly load data into DataStore. A replacement for DataPusher.
GNU Affero General Public License v3.0
44 stars 50 forks source link

resource_data page gives HTTP 504 timeout on very large resources #187

Open ThrawnCA opened 1 year ago

ThrawnCA commented 1 year ago

The resource_data page doesn't paginate the log entries that it's displaying, so very large resources (eg https://www.data.qld.gov.au/dataset/queensland-covid-19-case-line-list-age-groups/resource/a14317b7-2fca-41b7-8294-9a1f7a085b0f with 1.7 million records) will result in excessively long page load times (our system times out at 30 seconds).