search

rOpenGov / eurostat

R tools for Eurostat data
http://ropengov.github.io/eurostat
Other
234 stars 46 forks source link

get_eurostat_raw fails with the id sts_inppd_m #303

Closed iNANOV closed 4 months ago

iNANOV commented 4 months ago

Hello,

The get_eurostat function fails with the download of sts_inppd_m Eurobase table. It did work 7 days ago.

get_eurostat("sts_inppd_m") Dataset query already saved in cache_list.json... Error in get_eurostat("sts_inppd_m") : get_eurostat_raw fails with the id sts_inppd_m

pitkant commented 4 months ago

@iNANOV thank you for reporting.

This is actually a similar issue as described in issue #293 replies - the full dataset is so big that Eurostat API offers an asynchronous response instead of immediately offering the full dataset for download. If it worked 7 days ago as you reported then that narrows down the timeline of when Eurostat have potentially changed their policies.

If you do not need flags you could try to filter the dataset to a more manageable size.

iNANOV commented 4 months ago

Thank you for the advice, it works with pre filtering.

pitkant commented 4 months ago

Good to hear. I'm sure Eurostat folks also prefer that people pre-filter their queries rather than getting full datasets and filtering them locally out of habit.

Still, some issues might be harder to solve with just filtering and we will have to explore solutions on how to solve these problems. I will close this issue but leave the other one open.