search

linwoodc3 / gdeltPyR

Python based framework to retreive Global Database of Events, Language, and Tone (GDELT) version 1.0 and version 2.0 data.
https://linwoodc3.github.io/gdeltPyR/
GNU General Public License v3.0
203 stars 53 forks source link

Not all available data is downloaded!!! #79

Open p-dre opened 7 months ago

p-dre commented 7 months ago

I get a lot of outputs that GDELT does not return any outputs for certain dates. However, if I check this manually, data is available and I can download it. I have also checked it in the data and this data is missing

`/home/python3.10/site-packages/gdelt/parallel.py:111: UserWarning: GDELT did not return data for date time 20210201044500 warnings.warn(message)

/home/python3.10/site-packages/gdelt/parallel.py:111: UserWarning: GDELT did not return data for date time 20210201014500 warnings.warn(message)

/home/python3.10/site-packages/gdelt/parallel.py:111: UserWarning: GDELT did not return data for date time 20210201001500 warnings.warn(message)`

p-dre commented 7 months ago

I have now run the query myself for one day as a test and am getting twice as many observations as via the package.

firmai commented 7 months ago

Same issue