openaq / openaq-fetch

A tool to collect data for OpenAQ platform.
MIT License
84 stars 39 forks source link

Hanoi reporting very incosistently #1086

Closed russbiggs closed 5 months ago

russbiggs commented 7 months ago

Hanoi is still reporting very poor data coverage compared to their site, even with the offset deplyoment. This needs additional review to figure out why so many measurements are being missed. IF the offset deployment is performing this poorly, i recommend seeking a different solution because its clearly not doing much of a job.

Screenshot 2024-02-22 at 6 44 27 AM
majesticio commented 7 months ago

Thanks for pointing this out, I will look into it and fix the issue.

majesticio commented 7 months ago

So I have compared measurements from the source's website to our fetched measurements. For instance the site Kim Liên (pm25):

Screenshot 2024-02-22 at 8 09 06 AM

if you look closely this appears to be consistent with our fetched data: Screenshot 2024-02-22 at 8 10 21 AM

I will continue to investigate this, there may be some measurement that aren't being picked up but there are data gaps from the source

majesticio commented 7 months ago

I have identified some of the data gaps, and they are consistent with the data we a receiving from the API. I am going to increase the hours fetched from 3 to 12 hours and observe this adapter over the next few days. If the coverage does not improve, the way we fetch data from this provider will need to be revisited.