Closed b-a0 closed 7 months ago
Sorry, another issue... (I think).
It seems as if not all data is exported in the gzip JSON file.
When exporting the data via https://nl.roaddanger.org/export/ I get:
roaddanger_org_data_all_text.json.gz
roaddanger_org_data_all_text.json
jq length .\roaddanger_org_data_all_text.json
However, when I visit https://nl.roaddanger.org/statistics/general I see there are approximately 14k crashes (this corresponds with the current crash ID's):
Due to the neat amount of 10000 items I suspect there is some limiting going on. I don't know PHP, but the export function does mention $maxRows = 10000; and this variable is used later in the SQL query. Could this be the culprit?
$maxRows = 10000;
This is fixed in latest version. There is an artificial limit. It has now been set to 100,000 crashes for the export.
Sorry, another issue... (I think).
It seems as if not all data is exported in the gzip JSON file.
When exporting the data via https://nl.roaddanger.org/export/ I get:
roaddanger_org_data_all_text.json.gz
(about 4.66 MB)roaddanger_org_data_all_text.json
(about 20.31 MB)jq length .\roaddanger_org_data_all_text.json
I get 10000 itemsHowever, when I visit https://nl.roaddanger.org/statistics/general I see there are approximately 14k crashes (this corresponds with the current crash ID's):
Due to the neat amount of 10000 items I suspect there is some limiting going on. I don't know PHP, but the export function does mention
$maxRows = 10000;
and this variable is used later in the SQL query. Could this be the culprit?