Partial Responses are being returned

[mattmakesmaps]

NYT Dude - Check for timeouts on the request Ryan: Make Chunked requests https://www.npmjs.com/package/chunked-request https://nodejs.org/en/docs/guides/anatomy-of-an-http-transaction/

[mattmakesmaps]

Maybe try:

• Creating a queue of all the requests to be sent
• Pop a request off of the queue, and execute.
• Try to parse JSON. if fail mark the request as failed and submit for retry.
• If success, save the response and grab another URL to try.

[mattmakesmaps]

What happens when I change maxconcurrentrequests for bottleneck to 1