-
# Problem with Incoming Data
## Legislature
Malaysia (Dewan Rakyat)
## Problem
The bot reports disappearing members and memberships.
Ceased members are no longer listed on the Wikipedia pag…
-
For every legislature, we should have a Morph.io scraper, that fetches info on as many of the members as possible from Wikidata.
The hardest part of this is finding good sources for this information …
-
```
UserWarning: No parser was explicitly specified, so I'm using the best available HTML parser for this system ("lxml"). This usually isn't a problem, but if you run this code on another system, or…
-
-
# Source of New Data
## Legislature
South Korea - National Assembly
## Source
https://ko.wikipedia.org/wiki/%EB%8C%80%ED%95%9C%EB%AF%BC%EA%B5%AD_%EC%A0%9C20%EB%8C%80_%EA%B5%AD%ED%9A%8C%EC%9D%98%EC%9…
-
It would be nice, if the History in a recipe could show more details like which worker and how long it needed:
## History
scraper_started | 5 minutes ago
worker | status | when …
-
So, I tested out the scraper today and even though we have multiple instances, it seems to be going to need a CRAP ton of time to get the html from the many links for later parsing.
I started looking…
-
## Legislature
Dominican Republic/Chamber of Deputies
## Problem
Lots of new people being added to 2010 term, when they're almost certainly from a new term: https://github.com/everypolitician/everyp…
-
### Recipe URL
https://farm.openzim.org/recipes/wikipedia_en_top
### Last log lines
```true
starting redis-server in the background…
(node:13) NOTE: We are formalizing our plans to enter AWS SDK f…
-
We would like to be able to compare the current members of the Bundestag according to Wikidata with those on the German Wikipedia list, to see if it's up to date. We do this by creating a prompt (see …