search

everypolitician / everypolitician-data

data for national legislatures worldwide
http://everypolitician.org/
237 stars 54 forks source link

Malaysia (Dewan Rakyat): Losing members and memberships #25843

Open ondenman opened 7 years ago

ondenman commented 7 years ago

Problem with Incoming Data

Legislature

Malaysia (Dewan Rakyat)

Problem

The bot reports disappearing members and memberships.

Ceased members are no longer listed on the Wikipedia page. screen shot 2017-02-16 at 10 17 29 screen shot 2017-02-16 at 10 18 04 screen shot 2017-02-16 at 10 18 33

Proposed Solution

Scrape historical revisions of term page.

Steps

ondenman commented 7 years ago

Updated steps

ondenman commented 7 years ago

~I updated the scraper to scrape historical revisions of the article but @tmtmtmtm has suggested that a better way would be to update the article itself. https://github.com/everypolitician-scrapers/malaysian_parliament-wp/pull/3#event-974487709~

~I've add this step to the list.~

tmtmtmtm commented 7 years ago

@ondenman that's not quite what I suggested…

ondenman commented 7 years ago

Ah, sorry; reading too fast.

The suggestion is that the missing data should be added to Wikidata.

ondenman commented 7 years ago

Lots more membership changes now. Some subtle changes: screen shot 2017-03-30 at 16 32 10

ondenman commented 7 years ago

Party changes: screen shot 2017-03-30 at 16 33 46

ondenman commented 7 years ago

There are more changes in the most recent PR.