covidatlas / li

Next-generation serverless crawler for COVID-19 data
Apache License 2.0
57 stars 33 forks source link

Saudi Arabia regions missing #239

Open joliss opened 4 years ago

joliss commented 4 years ago

/cc @qgolsteyn

As of today, per-region data for Saudi Arabia seems to be missing.

Example of the original data: https://www.corona-cases.org/li/SA/01 Screenshot (because the page goes away whenever it's missing from the JSON)

Here's the missing regions:

-    <a class="list-group-item stretched-link" href="/SA/01">Riyadh Region, Saudi Arabia</a>
-    <a class="list-group-item stretched-link" href="/SA/03">Al Madinah Region, Saudi Arabia</a>
-    <a class="list-group-item stretched-link" href="/SA/04">Eastern Region, Saudi Arabia</a>
-    <a class="list-group-item stretched-link" href="/SA/05">Al-Qassim Region, Saudi Arabia</a>
-    <a class="list-group-item stretched-link" href="/SA/06">Hayel Region, Saudi Arabia</a>
-    <a class="list-group-item stretched-link" href="/SA/07">Tabuk Region, Saudi Arabia</a>
-    <a class="list-group-item stretched-link" href="/SA/08">Northern Borders Region, Saudi Arabia</a>
-    <a class="list-group-item stretched-link" href="/SA/09">Jazan Region, Saudi Arabia</a>
-    <a class="list-group-item stretched-link" href="/SA/10">Najran Region, Saudi Arabia</a>
-    <a class="list-group-item stretched-link" href="/SA/14">&#39;Asir Region, Saudi Arabia</a>
joliss commented 4 years ago

This appears to be fixed in the latest dataset.

joliss commented 4 years ago

Hm. Now it's gone again.

camjc commented 4 years ago

Currently we're getting 504: gateway timeout. Its a 3.6mb file, seems like this is on the edges of what works either for them or for us.