This PR adds a workaround given that the bulk download service is down (again!).
It relies on a full CRS parquet file shared by the OECD (current up to May 2024).
The download is really big (1GB). It will still try to use the bulk download service first just in case. Otherwise it will download it from our Google drive as a temporary measure.
Predicate pushdown is used to filter by year to avoid loading too much of the CRS at once.
This PR adds a workaround given that the bulk download service is down (again!). It relies on a full CRS parquet file shared by the OECD (current up to May 2024).
The download is really big (1GB). It will still try to use the bulk download service first just in case. Otherwise it will download it from our Google drive as a temporary measure.
Predicate pushdown is used to filter by year to avoid loading too much of the CRS at once.