datopian / datahub

🌀 Rapidly build rich data portals using a modern frontend framework
https://datahub.io/opensource
MIT License
2.17k stars 322 forks source link

Airport codes preview is not loading #1098

Closed anuveyatsu closed 1 month ago

anuveyatsu commented 2 months ago

This is probably because of size of file (>7MB) and we are loading first 5MB by default to preview. It is probably too much (?)

How to reproduce

Expected behavior

Loads quickly by loading only ~1MB of data.

rufuspollock commented 1 month ago

OK, digging a bit deeper apart from the old /r/ links not working the issue is that the code-list.csv did not copy over correctly i.e. this file is empty https://r2.datahub.io/clt98kf5h0002ia08617w20im/main/raw/data/code-list.csv

https://datahub.io/core/un-locode - code-list data file never seemed to copy across ... https://r2.datahub.io/clt98kf5h0002ia08617w20im/main/raw/data/code-list.csv - file exists but 0 bytes (should be 7mb)

olayway commented 1 month ago

Fixed

rufuspollock commented 1 month ago

This is now working https://datahub.io/core/airport-codes

Issue was that files over a certain size were not being copied over to storage on sync.

image