briatte / elus

Bayesian ideal points of French politicians, based on Twitter data.
5 stars 4 forks source link

Cross-check accounts with EveryPolitician? #5

Open briatte opened 7 years ago

briatte commented 7 years ago

@florence-nocca suggests that we take a look at the data collected by @tmtmtmtm and others at EveryPolitician, to see whether it can be useful to improve our own (French) politicians data

EveryPolitician has data for terms 12, 13 and 14 of the National Assembly:

tmtmtmtm commented 7 years ago

Hi @briatte — this certainly looks like an interesting project! We've been planning to significantly improve our French data for a while now (including adding a lot more historical data), and this might be a useful impetus for that! So if there's anything we can do that would be useful for you (or if you spot any problems in our existing data), please do let us know.

briatte commented 7 years ago

Thanks @tmtmtmtm – the project in this repo is about Twitter account holders among French politicians, but I must have told you about the Sycomore historical database of French MPs in the past, right?

tmtmtmtm commented 7 years ago

Yes: there's an initial stab at a scraper at https://github.com/everypolitician-scrapers/france-national-assembly-sycomore, but if I remember correctly there were more issues with the data from there than I had expected, particularly around dates. This was a while ago, though, so the details are a little hazy. I think that between Sycomore, Wikidata, and the French Wikipedia, there's almost certainly very good data now that goes back to at least 1958. We just need to get around to tying it all together.

briatte commented 7 years ago

I barely remember my own code, but yes, there are issues with the data, perhaps especially if you want precise (yyyy-mm-dd) dates of entry/exit to the lower chamber. Things are easier if you just need the legislature number, which is my case.

Tying it together would be nice indeed, but that's a real technical challenge. It's on my TODO list for the summer, when I start updating parlnet again.