openaq / openaq-fetch

A tool to collect data for OpenAQ platform.
MIT License
84 stars 39 forks source link

Turkiye reporting inconsistently #1047

Open russbiggs opened 1 year ago

russbiggs commented 1 year ago

It looks like we're getting spotty coverage from Turkiye. Looking a number of locations many hourly measurements are missing e.g. sensor_node 368956

Screenshot 2023-07-17 at 11 44 38 AM
majesticio commented 1 year ago

This is one of the simpler adapters, so I doubt it is on our end, but I will investigate further before we close this issue.

russbiggs commented 1 year ago

this could be an issue on ingestion as well. Definitely worth investigating a couple of different angles

russbiggs commented 1 year ago

@majesticio any update on this? looks like we're still getting spotty coverage

majesticio commented 1 year ago

@russbiggs I have not identified any problems with the code, I will keep an eye on this manually and see if I can catch one of the discrepancies and troubleshoot from there

majesticio commented 1 year ago

So each request from the Turkiye adapter returns measurements for all 300+ stations for just one hour. My guess is that some of the responses are returning empty handed. Perhaps we can explore using the offset deployment to fetch the same url 2 or even 3 times per hour

majesticio commented 8 months ago

Turkiye's site has been down for weeks. We should continue to check on it periodically:
https://sim.csb.gov.tr/SERVICES/airquality

majesticio commented 5 months ago

Turkiye is apparently still live, but has been shut off to people outside of Turkiye. Possibility of using some kind of proxy to get the data should be explored.