openaq / openaq-fetch

A tool to collect data for OpenAQ platform.
MIT License
83 stars 39 forks source link

Add south korea #1090

Closed majesticio closed 3 months ago

majesticio commented 3 months ago

South Korea air quality data from 'Korea Air' with ~650 stations. This adapter is a bit slow so it currently has its own deployment.

Some breaking changes include update to our custom request client with updates to all the adapter that use it. The client us more robust, with error handling, and will only retry on errors other the timeouts, which were causing problems with the fetch lambdas not being able to finish if an adapter timed out and retried 3 times. You can also pass url, params, headers, timeout, retries, method, responseType and https to the client. url is the only required param and makes a GET request and parses JSON by default. If the responseType expected is text, that needs to be declared