welfare-state-analytics / riksdagen-corpus

Swedish parliamentary proceedings - Riksdagens protokoll 1867-today
Other
26 stars 5 forks source link

List missing parties and fill out in Wikidata #349

Closed MansMeg closed 5 months ago

MansMeg commented 1 year ago

We should start filling out parties for those MPs who are currently missing this. We will do that in the following steps:

salgo60 commented 1 year ago

Example odd thing that I marked depreciated and contemporary constraint issue

image

says in Tvåkammar Riksdagen (h) that I thought was Högerpartiet Q111033682 but my understanding is that this name started in 1952 and more correct is Högerns riksorganisation Q122599272

My try in Wikidata

image

To get something started I mark those WD records were I see a potential problem with P5008 on focus list of Wikimedia project = Q120143028 - Välfärden analyserad - parti

SPARQL list - > 200 items right now

image
BobBorges commented 1 year ago

Have we settled on using historical party names?

On the file I got back from Lirre, a handful of rows have party lmb with party_id:Q110843 and historical_party_id:Q10554125.

fredrik1984 commented 1 year ago

Yes. We discussed this last Friday. We will focus on adding the actual historical party names. Then researchers can create aggregated party names based on our work.

However, it might be that we will do something like this anyway. But the priority should be to focus on the empirical data.

MansMeg commented 1 year ago

Yes. We should only store the historical data. Ie the party they belonged to for a given date.

BobBorges commented 1 year ago

Here's a google sheet with MPs missing at least one party affiliation in our metadata:

https://docs.google.com/spreadsheets/d/1bywraAUEoRy-XPNjfk-7rpMhnQKLJc1EvSQyP3S9GII/edit?usp=sharing

It should be open for anyone with the link, but lmk if any of you have trouble opening it.

fredrik1984 commented 1 year ago

Excellent! I just asked for permission to edit. I can divide the list between @Lottabrorsson, Mattias, and me.

The principle is to follow the bio books. If a MP never belonged to a party this should also be noted. Also if the MP was a "vilde"

BobBorges commented 1 year ago

I've just added columns start and end (should've been there from the start), so when that info is in the books, pls add it too. And if you find people with multiple affiliations, just duplicate the row and add different parties separately (w/ start/end if possible).

image

BobBorges commented 1 year ago

I just asked for permission to edit.

I guess the others also have to do that. I didn't get any notice of this request, so Lotta, Mattias, just DM on slack or email me if I don't grant your permissions within a reasonable amount of time :D

fredrik1984 commented 1 year ago

Hm, should an MP that does not belong to a party be linked to this: https://www.wikidata.org/wiki/Q327591 ?

I write "no party" in the Google Excel file.

MansMeg commented 1 year ago

Whatever is easiest, I think. But @BobBorges might have other thoughts.

BobBorges commented 1 year ago

I also wrote "None" (python friendly) in one of the rows. I don't see any reason to link nothing to something, but others please weigh in here.

salgo60 commented 1 year ago

no party

In Wikidata we use "no value" and add a source like Two-Chamber Parliament 1867-1970. That is a negative statement i.e. The source confirm the lack of party value

image

see Q5797559#P102 below

image

.

image

All Swedish PM people in WD - no value 1184

BobBorges commented 1 year ago

I retract my statement

I don't see any reason to link nothing to something

Explicitly setting no value is a good way to disambiguate people who didn't belong to a party (with a source) from people whose party no one checked/uploaded.

@salgo60 I'll use this when uploading to wikidata

@fredrik1984 @Lottabrorsson (does mattias have github) -- in the google sheet write None or No party and I'll handle the novaluesnak from those values.

Lottabrorsson commented 1 year ago

I retract my statement

I don't see any reason to link nothing to something

Explicitly setting no value is a good way to disambiguate people who didn't belong to a party (with a source) from people whose party no one checked/uploaded.

@salgo60 I'll use this when uploading to wikidata

@fredrik1984 @Lottabrorsson (does mattias have github) -- in the google sheet write None or No party and I'll handle the novaluesnak from those values.

@BobBorges Mattias may have some problem with his login but he will look at that tomorrow.

BobBorges commented 1 year ago

Party info from Lirre was added to the google sheet -- will upload everything in one go when the sheet is ready.

fredrik1984 commented 1 year ago

So, now I am done with my share of looking up MPs with no wikidata party:

https://docs.google.com/spreadsheets/d/1bywraAUEoRy-XPNjfk-7rpMhnQKLJc1EvSQyP3S9GII/edit#gid=336275707

Now, let's wait for Lotta and Mattias and then Bob can add these.

salgo60 commented 1 year ago

if you add to Wikidata add a source just party with no source can easily be deleted as not trusted...

MansMeg commented 1 year ago

Yes. We should add a source. We should also use this google sheet that Fredrik put there as a unit test for the corpus to check that these party affiliations are included in the corpus. I added that as a task above.

BobBorges commented 6 months ago

By chance, I found two entries in the manual data, where the MPs should get assigned No party, but exist in Wikidata with a party, which is also present on the referenced pages in the bio books.

https://www.wikidata.org/wiki/Q5967169 Image

https://www.wikidata.org/wiki/Q5574217 Image

Am I missing something here, or it's an error with the manual data? @fredrik1984 @Lottabrorsson

fredrik1984 commented 6 months ago

It looks like a manual error (probably by me since Lotta and Mattias are so thorough)! Hence, the should be assigned parties (lmp in both cases).

BobBorges commented 5 months ago

@Lottabrorsson @fredrik1984 These are the remaining questions after updating wikidata from the manual work you did with party membership. Could you take a second look at these cases?

<!DOCTYPE html>

  | wiki_id | person_id | reference | note | start | end | party_wiki_id | party_abbrev -- | -- | -- | -- | -- | -- | -- | -- | -- ? | Q6026244 | i-UdMTB3XcTo7EfJoec6jQJk | 4:430 | Felaktigt inlagd Q10499215 | 1912 | 1914 | Q1594086 | lib s ? | Q5796156 | i-PkDNy9bEbEnW9xaNKSjppw | 5:298 | h saknas, men vilket ska det vara? | 1935 | 1941 |   | h ? | Q5568434 | i-SmANBDpEMp49AgxGMgLJX | 1:55 | It says "centern" in the bio book but the start/end years are AFTER the party existed | 1893 | 1893 | Q10444846 | centern ? | Q5795740 | i-KaBa73f9cDZ3KHsxdHYgui | 1:436 | It says "centern" in the bio book but the start/end years are AFTER the party existed | 1888 | 1891 | Q10444846 | centern ? | Q6167502 | i-P8XgFPqiTRHFcNFh5XMfy8 | 2:181 | no year stated in the bio book Q10444846 and Q10444847 both centern? | ? | ? | Q10444846 | centern ? | Q5776520 | i-Tb3QUhGvYi4j7F3VwMLWH7 | 1:92 | no year stated in the bio book – bio book says “vänstern” Q111597190? (same guy in vol 4 says vänstervilde) | ? | ? | Q111108382 | "västervilde" ? | Q5806065 | i-3Vt59Mph8bZHW3Yk38AtwE | 2:383 | no year stated in the bio book – wiki id for party is different | ? | ? | Q110843 | h ? | Q5603236 | i-SP5YPpt92pVj8ZPcZjt3GV | 2:266 | Only nya lmp has a year in the bio book | ? | ? | Q6487621 | lmp ? | Q5955465 | i-HEaiAtuCoZP4zvRQQyuhM7 | 3:133 | Q-nr är en annan person, namnet hör till Q5955520 ; 1876-06-03 |   |   | Q105112 | s ? | Q5556673 | i-Vofu3seWF5yQe8KpMLXV3T | 4:205 | Står Q111033682 Men Något är fel med partiet h, vilket ska det vara?https://www.wikidata.org/wiki/Q111077860 | 1938 | 1951 | Q111077860 | h ? | Q5570120 | i-Ui4MNjsjiePyrsfZ1FnUm7 | 4:206 | Står Q111033682 Men Något är fel med partiet h, vilket ska det vara?https://www.wikidata.org/wiki/Q111077860 | 1935 | 1942 | Q111077860 | h ? | Q5789075 | i-3DJPoU6X43Z3gZwYQ5mZfw | 5:351 | Står Q111033682 Men Något är fel med partiet h, vilket ska det vara?https://www.wikidata.org/wiki/Q111077860 | 1935 | 1944 |   | h ? | Q5937245 | i-FhTohnRic91X2Lkt914b7Q | 4:247 | Står Q111033682 Men Något är fel med partiet h, vilket ska det vara?https://www.wikidata.org/wiki/Q111077860 | 1935 | 1943 | Q111077860 | h ? | Q6011353 | i-RZvCDDC9zwyuV3rH48onze | 5:430 | Står Q111033682 Men Något är fel med partiet h, vilket ska det vara?https://www.wikidata.org/wiki/Q111077860 | 1935 | 1940 | Q111077860 | h ? | Q6014382 | i-HWuy1bfrVaJd5tRcAdeD1m | 4:128 | Står Q111033682 Men Något är fel med partiet h, vilket ska det vara?https://www.wikidata.org/wiki/Q111077860 | 1935 | 1942 | Q111077860 | h ? | Q6093360 | i-UXRUTZDfYdtzvHei35SC2n | 5:436 | Står Q111033682 Men Något är fel med partiet h, vilket ska det vara?https://www.wikidata.org/wiki/Q111077860 | 1935 | 1938 | Q111077860 | h ? | Q10501501 |   | 5:263 | Stod inga årtal i Wiki – wiki_id is for a party | 1905L | 1911 | Q10501501 | mod ? | Q6237662 | i-NPaHZmLBpwn5suNf7XNkx5 | 1:460 | This is an example of party name in wikidata that is incorrect from a historical point of view but still is the same party | 1935 | 1936 | Q110843 | h ? | Q6237662 | i-NPaHZmLBpwn5suNf7XNkx5 | 1:460 | This is an example of party name in wikidata that is incorrect from a historical point of view but still is the same party | 1941 | 1944 | Q110843 | h ? | Q5608541 | i-McNdJaEnje6pXfi83cxxZW | 3:204 | Tidsperiod för parti inte angiven i Wikidata | 1917 | 1917 | Q1309957 | vilde ? | Q6178909 | i-B7hrTkCutn2YGLqw9zbUd2 |   | Dude has mandates in the unicameral period, but party memberhsip stops in 1970 on wikidata,. I extended (c) (Q110832) for him until 1982 per biobook EK1:105. I assume it’s the same centerpartiet. |   |   |   |  
Lottabrorsson commented 5 months ago

Q5603236

@BobBorges @fredrik1984 I can look at them. Get back to you later this week.

fredrik1984 commented 5 months ago

Great work Bob! And thank you Lotta for taking a look at these MPs that Bob listed. Get back to me if you need input.