Number of morpheme != number of cogids ?

[XachaB]

Hi,

In this dataset, I find many cases where the number of morphemes does not match the number of cogids, which is a problem when evaluating cognate recognition. Examples:

4 morphemes, 2 cogids:

https://github.com/lexibank/baf2/blob/9cef1b1bc34debe937a1c7c1c08c9d3137a7cc77/cldf/forms.csv#L8695

1 morpheme, 2 cogids:

https://github.com/lexibank/baf2/blob/9cef1b1bc34debe937a1c7c1c08c9d3137a7cc77/cldf/forms.csv#L363

2 morpheme, 1 cogid: https://github.com/lexibank/baf2/blob/9cef1b1bc34debe937a1c7c1c08c9d3137a7cc77/cldf/forms.csv#L69

Is it intended ? If yes, what are the intended semantics ?

[LinguList]

The cognate identifiers were only used as a first pass of the data and later manually edited and unvoluntarily modified. Our goal was to receive the borrowing identifiers, which you find in the EDICTOR application. We do not recommend to use the COGIDS, since they have anyway been automatically computed first and have more errors than the mismatch with morphemes. We should not add these to the data in forms.csv, I guess, to avoid misunderstandings.

[LinguList]

Ah, wait: we better check the cases when loading data from edictor.

[LinguList]

In fact, @indianatones, it would be good if you could quickly check these cases, which I just identified:

WARNING wrong cogids 69 / ANIMAL / BozoKorondougounord: [54] vs. b i r a + ⁿt e u
WARNING wrong cogids 94 / ANSWER / ToroTegu: [65] vs. tʃ ⁵/i + s ⁵/u
WARNING wrong cogids 109 / ANSWER / Penange: [65] vs. k ⁵/i + dʒ ⁵/ɛ
WARNING wrong cogids 113 / ARMPIT / Fulfulde: [79] vs. n a w + k i
WARNING wrong cogids 140 / ARMPIT / Bambara: None vs. n ⁵/a n ¹/a
WARNING wrong cogids 217 / BACK / Jamsay: [115] vs. ɡ ¹⁵/u + n
WARNING wrong cogids 234 / BAD / TommoSo: [128] vs. p ¹/a d ⁵/i + ⁵/ɛ
WARNING wrong cogids 278 / BARK / Bunoge: [142] vs. k ¹/o b ¹/a + l ¹/i
WARNING wrong cogids 327 / BEARD / DonnoSo: [182, 184, 186] vs. b ¹/ɛː + k ¹/e + ⁿɡ ¹/e + l ⁵/e
WARNING wrong cogids 337 / BEARD / PergeTegu: [182, 182] vs. b ¹/ɛ + b ¹⁵/ɛ + w
WARNING wrong cogids 347 / BEARD / ToroTegu: [182] vs. b ¹⁵/ɛ + w
WARNING wrong cogids 354 / BEAUTIFUL / BozoHainyaxo: [197, 198] vs. h ⁵/a r ⁵/a ᵐp ⁵/a r ¹/e
WARNING wrong cogids 355 / BEAUTIFUL / BozoHainyaxo: [209] vs. tʃ ¹/ɛ + ɲ ⁵/i
WARNING wrong cogids 383 / BEGIN / SonghaiSenni: [222] vs. s ⁵/i n + t ⁵¹/i n
WARNING wrong cogids 384 / BEGIN / SonghaiKiini: [222] vs. s ⁵/i n + t ⁵¹/i n
WARNING wrong cogids 385 / BEGIN / ToroTegu: [223] vs. d ¹/ɛ w + r ⁵/u
WARNING wrong cogids 455 / BELT / TiranigeDiga: [240, 254] vs. s ⁵/æ̃ː t j j r
WARNING wrong cogids 471 / BESIDE / Mombo: [263] vs. b ⁵/a ŋ + ɡ ¹/ũ:
WARNING wrong cogids 473 / BESIDE / Fulfulde: [262] vs. b a n + ⁿɡ e
WARNING wrong cogids 479 / BESIDE / Soninke: [265] vs. b ⁵/a ŋ + ŋ ¹/e
WARNING wrong cogids 492 / BIG / ToroTegu: [291] vs. s ⁵/ɛ + w
WARNING wrong cogids 498 / BIG / TogoKan: [287] vs. k ⁵/a + ŋ
WARNING wrong cogids 518 / BIG / Bambara: [484] vs. j ¹/e + j ⁵/i
WARNING wrong cogids 527 / BIRD / TebulUre: [3] vs. ¹/a + d ⁵/e
WARNING wrong cogids 530 / BIRD / Bunoge: [295] vs. n ⁵/iː + b ¹/e
WARNING wrong cogids 534 / BIRD / TiranigeDiga: [295] vs. n ⁵/i + j ¹/e
WARNING wrong cogids 535 / BIRD / Mombo: [295] vs. ¹/i + n ⁵/i
WARNING wrong cogids 536 / BIRD / Penange: [295] vs. n ¹/e dʒ + dʒ ⁵/e
WARNING wrong cogids 590 / BITTER / BankanTey: [325] vs. ɡ ¹/a r ¹⁵/u + m
WARNING wrong cogids 603 / BITTER / DonnoSo: [325, 332] vs. ɡ ¹/a l l ⁵/u
WARNING wrong cogids 604 / BITTER / Mombo: [325, 336] vs. k ⁵/a r ⁵/a + k ⁵/a r ⁵/a + k ⁵/a n n ⁵/i

[LinguList]

If you use the new code, you can just type:

$ cldfbench download lexibank_baf2.py

And compare if the errors are accounted for or not. We should head for having the errors handled when submitting the study.

[LinguList]

In fact, I just saw that we should drop the cogids, and keep only cogid and borid. So this can be closed then. Thanks for discussion, @XachaB!

[IndianaTones]

In fact, I just saw that we should drop the cogids, and keep only cogid and borid. So this can be closed then. Thanks for discussion, @XachaB!

I think I will reopen this and fix these - I did originally go through and correct the COGIDs manually so it is likely my own work that caused these errors!

[LinguList]

I'll add a check then, so you can calll it and see how much you improve, and you could also look into #4, as I am doing all of these now automatically, but they should be fixed from your side in EDICTOR as well.

[IndianaTones]

working on this now but getting an error upon running

cldfbench download lexibank_baf2.py

I get

PermissionError: [Errno 13] Permission denied:

[LinguList]

Can you share the full error code please? And please also note that I modified the command, as I first thought we could drop working on this from edictor.

[LinguList]

Here is an updated list, code will be available soon. The permission error must come from some github settings, or internal computer settings, so you best use a fresh virutal env and git-clone everything. Note that there are some instances where an etnry has NO COGIDS, these should be set to 0 or better in edictor, to a new ID, which you trigger by adding some string (e.g., ?) into the field.

ID / Concept	Language	COGIDS	TOKENS
WARNING 234: BAD	TommoSo	128	p ¹/a d ⁵/i + ⁵/ɛ
WARNING 278: BARK	Bunoge	142	k ¹/o b ¹/a + l ¹/i
WARNING 354: BEAUTIFUL	BozoHainyaxo	197 198	h ⁵/a r ⁵/a ᵐp ⁵/a r ¹/e
WARNING 355: BEAUTIFUL	BozoHainyaxo	209	tʃ ¹/ɛ + ɲ ⁵/i
WARNING 455: BELT	TiranigeDiga	240 254	s ⁵/æ̃ː t j j r
WARNING 492: BIG	ToroTegu	291	s ⁵/ɛ + w
WARNING 530: BIRD	Bunoge	295	n ⁵/iː + b ¹/e
WARNING 535: BIRD	Mombo	295	¹/i + n ⁵/i
WARNING 603: BITTER	DonnoSo	325 332	ɡ ¹/a l l ⁵/u
WARNING 604: BITTER	Mombo	325 336	k ⁵/a r ⁵/a + k ⁵/a r ⁵/a + k ⁵/a n n ⁵/i
WARNING 653: BLANKET	YandaDom	352	j ¹/a + ⁿb ⁵/u
WARNING 654: BLANKET	BonduSo	352	j ⁵/a + ⁿb ⁵/uː
WARNING 657: BLANKET	Nanga	352	j ⁵/e + ⁿb ⁵/i
WARNING 658: BLANKET	BankanTey	352	j ⁵/o + ⁿb ⁵/iː
WARNING 659: BLANKET	TiranigeDiga	352	j ¹/o + ⁿb ¹/u
WARNING 660: BLANKET	TommoSo	352	j ⁵/o + ⁿb ⁵/u
WARNING 662: BLANKET	Bambara	N o n e	d u w ⁵/o
WARNING 689: BLOOD	Jamsay	391	n ¹⁵/ɛ + j̃
WARNING 690: BLOOD	BankanTey	385	ɡ ¹/o ⁿɡ ¹/o + r ⁵/o
WARNING 692: BLOOD	BenTey	385	ɡ ¹/o ⁿɡ ¹/o + r ⁵/o
WARNING 693: BLOOD	Nanga	385	ɡ ¹/o ⁿd ¹/u + ɡ ⁵/o
WARNING 694: BLOOD	PergeTegu	392	n ¹⁵/ɛ + m
WARNING 695: BLOOD	Gourou	391	n ¹⁵/ɛ + j̃
WARNING 698: BLOOD	TommoSo	397	¹/i l ¹/i + j ⁵/e
WARNING 710: BLOOD	Bangime	384	j ³/i + j ¹/i
WARNING 734: BLUNT	DogulDom	401	d ¹/u ⁿb ¹/u + ɡ ⁵/u
WARNING 747: BOAT	Bambara	409	b ⁵/a l ⁵/ã + k ⁵/a
WARNING 749: BOAT	BonduSo	411	¹/a l ɡ ¹/u + ⁿb ¹⁵/aː
WARNING 786: BODY	Fulfulde	434	t e r + ɗ e
WARNING 897: BREAST	PergeTegu	490	¹⁵/ɛ + m
WARNING 902: BREAST	YandaDom	490	⁵/ɛ + m ⁵/ɛ
WARNING 1027: BURN (SOMETHING	SonghaiKiini	553	k ¹/u + k ⁵/u r ¹/e + j
WARNING 1028: BURN (SOMETHING	SonghaiSenni	553	k ¹/u + k ⁵/u r ⁵¹/e
WARNING 1175: CASSAVA	DogulDom	614	k ¹/uː + b ¹⁵/eː + ɡ
WARNING 1181: CASSAVA	Jamsay	73	b ¹/a n ¹/a ŋ + k ⁵¹/u
WARNING 1182: CASSAVA	TiranigeDiga	73	b ¹/a n ¹/a ŋ + k ¹/u
WARNING 1183: CASSAVA	Mombo	76	b ⁵/a rⁿ ⁵/a + k ⁵/uː
WARNING 1185: CASSAVA	Jenaama	73	b ⁵/a n ¹/a ŋ + k ⁵/uː
WARNING 1186: CASSAVA	BenTey	76	b ¹/a l ¹/a + k ⁵¹/ũː
WARNING 1187: CASSAVA	PergeTegu	73	b ⁵/a n ⁵/a + ŋ̀/ŋ + k ¹/u:
WARNING 1188: CASSAVA	TogoKan	76	b ⁵/a n ¹/a + k ³¹/u
WARNING 1189: CASSAVA	TommoSo	73	b ⁵/a n ⁵/a + k ¹/uː + b ⁵/e r ⁵/e
WARNING 1190: CASSAVA	YandaDom	73	b ⁵/a n ⁵/a + k ¹/u r ¹/u + w ¹/o s ⁵ /o
WARNING 1191: CASSAVA	BonduSo	73	b ⁵/a n ⁵/a + k ¹/uː + b ¹/a: ɡ ¹/a
WARNING 1192: CASSAVA	Bunoge	73	b ⁵/a n ⁵/a n + k ¹/u + t ⁵/i m ⁵/ɛ
WARNING 1193: CASSAVA	Fulfulde	74	b ⁵/a n ⁵/a + k ¹/u l + t ¹/a n ¹/a
WARNING 1194: CASSAVA	Gourou	73	b ⁵/a n ⁵/a ŋ + k ⁵¹/u: + ⁿɡ ¹/o
WARNING 1195: CASSAVA	Nanga	73	b ⁵/a n ⁵/a ŋ + k ⁵/uː
WARNING 1245: CAVE	BenTey	644	k ¹/o + ⁿb ¹⁵/iː
WARNING 1246: CAVE	BankanTey	644	k ¹/o + ⁿb ⁵/iː
WARNING 1247: CAVE	Nanga	644	k ¹/o + ⁿb ⁵/i
WARNING 1248: CAVE	PergeTegu	644	k ⁵/oː + m
WARNING 1249: CAVE	TogoKan	644	k ¹/ɔː + m ⁵/ɔ
WARNING 1250: CAVE	YornoSo	644	k ¹/ɔ + m ⁵/ɔ
WARNING 1251: CAVE	TommoSo	644	k ¹/ɔ m + m ⁵/ɔ
WARNING 1253: CAVE	YandaDom	644	k ¹/o + m
WARNING 1254: CAVE	BonduSo	644 645	k ¹/o + ⁿb ¹⁵/iː + ⁿɡ ⁵/e
WARNING 1255: CAVE	Bunoge	646	t ⁵/e + ⁿɡ ¹/a
WARNING 1256: CAVE	Jamsay	644	k ⁵/o + m
WARNING 1257: CAVE	TiranigeDiga	644	k ⁵/o + w̃
WARNING 1259: CAVE	Penange	650	s ⁵/ɔ + ⁿɡ ⁵/ɔ
WARNING 1362: CHIEFTAIN	BozoDebo	697	n o ɡ u + t u
WARNING 1445: CLOUD	Nanga	757 743	j ¹/a r + k ¹/u m ¹/u + ∼/r̃ ⁵/a
WARNING 1447: CLOUD	Gourou	743	k ¹/u r ¹/u + w ⁵/ɔ
WARNING 1496: COLD	Bunoge	766 765	t ¹/o ⁿb ¹/o
WARNING 1505: COLD	Bangime	764 0	j ⁵/i ⁿb ³/o
WARNING 1506: COLD	Fulfulde	772	ɓ uː ɓ + o l
WARNING 1560: COME BACK	Fulfulde	795	n a b b + i t a
WARNING 1582: COTTON	Mombo	802 803	k ɔː n d ⁵/i
WARNING 1668: COW	SonghaiSenni	848 849	h ⁵/á w ⁵/ó
WARNING 1718: DAY (NOT NIGHT)	DogulDom	865	⁵/i s + ɡ ¹/aː
WARNING 1734: DEW	ToroTegu	893	¹/a r ⁵/a ⁿd ⁵/a + ŋ
WARNING 1905: DIVIDE	BonduSo	961	k ¹/aː + ⁿdʒ ⁵/iː
WARNING 1945: DOG	Bambara	N o n e	w ¹/u l u
WARNING 1947: DONKEY	ToroTegu	997	z ¹/a ⁿd ⁵/u + r ⁵/u
WARNING 1963: DONKEY	TomoKan	1009 1010	dʒ ¹/o n d ¹/u
WARNING 1965: DONKEY	Mombo	1001 1002	k ⁵/ɔ n j ¹/ɔ
WARNING 1973: DONKEY	Bambara	N o n e	f ¹/a l ⁵/i
WARNING 2009: DOOR	BonduSo	1027 1028	t ⁵/i ŋ ¹/aː
WARNING 2029: DOORPOST	Bangime	106	k ¹/o + n ¹/ɔ + ∼/w
WARNING 2088: DRINK	Bangime	107 1070 1071	ŋ ¹/i ∼/j̃ ¹/ɛ + r ¹/ɛ
WARNING 2168: DUST	BozoHainyaxo	1108	t ɔ l ɔ + d u
WARNING 2180: DYE	Bangime	N o n e	d ¹/i s ⁵/a
WARNING 2181: DYE	ToroTegu	619	s ⁵/i ŋ ⁵/i + n ⁵/e
WARNING 2183: DYE	BankanTey	N o n e	ɡ ¹/a r ⁵¹/a
WARNING 2196: DYE	Bambara	N o n e	ɡ ¹/a l ⁵/a
WARNING 2197: DYE	Fulfulde	N o n e	ɡ a r a
WARNING 2198: DYE	Soninke	N o n e	ɡ ¹/a r â
WARNING 2265: EARRING	Penange	1150	b ⁵/u k k ⁵¹/u + l
WARNING 2403: ELBOW	PergeTegu	1209	t ⁵/ɔ + t ⁵/ɔ ɡ ⁵/u
WARNING 2404: ELBOW	Gourou	1209	t ⁵/i + t ⁵/o ŋ
WARNING 2411: ELBOW	YandaDom	1209	t ⁵/ɔ n + d ⁵/ɔ
WARNING 2422: ELBOW	BozoKorondougousud	1214	s u õ + b ɔ l ɔ
WARNING 2423: ELBOW	BozoPondorisud	1214	s õ + b o r o
WARNING 2429: ELBOW	Bambara	N o n e	n ∼¹/ɔ ɡ ∼¹/ɔ + k ⁵/u r ⁵/u
WARNING 2477: ELEPHANT	Bambara	N o n e	s ¹/a m ⁵/a
WARNING 2501: EMPTY	Jamsay	1257	w ⁵/o + m
WARNING 2699: FAT (OBESE)	YandaDom	1352	b ¹⁵/i + n
WARNING 2810: FEAR (FRIGHT)	DogulDom	1402 1403	⁵/uː ɡ + ¹/iː + ɡ
WARNING 2818: FEAR (FRIGHT)	Fulfulde	1406	h u l + d e
WARNING 2821: FEAR (FRIGHT)	BozoKorondougounord	1400	t a b a k ẽ + d e
WARNING 2899: FINGER	Fulfulde	1450	f e ɗ eː + n d u
WARNING 2910: FINGER	Soninke	1446 1457	s u ɡ u + k õ: + d i õ
WARNING 3009: FIVE	ToroTegu	1507	n ¹⁵/uː + j
WARNING 3012: FIVE	Nanga	1507	n ¹/i + m ¹⁵/iː
WARNING 3013: FIVE	PergeTegu	1507	n ¹/u + m ¹⁵/iː
WARNING 3014: FIVE	Gourou	1507	n ¹⁵/uː + j̃
WARNING 3015: FIVE	TogoKan	1507	n ⁵/u + n ⁵/ɛː
WARNING 3039: FIVE	BozoKotya	1517	k ¹/a r ¹/a + ɡ ⁵/o
WARNING 3041: FIVE	BozoPondorisud	1512	k ɔ l ɔ + h ɔ
WARNING 3064: FLOWER	BenTey	1520	p ¹/u ∼/r̃ ¹⁵/u + j
WARNING 3176: FOLD	Nanga	1578	m ¹/ɛ n + d ⁵/i
WARNING 3238: FOOT OR LEG	BozoKorondougousud	1607	t a b a + k ∼/ɛ d ɛ
WARNING 3239: FOOT OR LEG	BozoKotya	1607	t ∼/ãː + t e b o
WARNING 3269: FOREHEAD	Jenaama	1619 1625	t ¹/e + ɡ ¹/e + ⁿtʃ ⁵/ĩ
WARNING 3277: FOREHEAD	Bambara	N o n e	t ∼⁵/e
WARNING 3291: FORGET	Jenaama	1636	n ¹/u m ¹/a + s ³/ã
WARNING 3327: FOUR	ToroTegu	1655	n ¹⁵/a + j
WARNING 3328: FOUR	BenTey	1655	n ¹⁵/iː + j̃
WARNING 3330: FOUR	Nanga	1655	n ¹⁵/ɔ + j̃
WARNING 3331: FOUR	PergeTegu	1655	n ¹⁵/a + j̃
WARNING 3334: FOUR	BonduSo	1655	k ⁵/ɛː dʒ ¹/ɛ + j
WARNING 3336: FOUR	DonnoSo	1655	n ¹⁵/aː + j
WARNING 3345: FOUR	TommoSo	1655	n ¹⁵/a + j
WARNING 3346: FOUR	YornoSo	1655	n ¹⁵/a + j̃
WARNING 3478: GIRL	Bambara	1712	d ⁵/ẽ + m ⁵/u s ⁵/o
WARNING 3481: GIRL	Soninke	1729	k ¹/i s ¹/i + m ¹/a r ⁵¹/e
WARNING 3691: GOD	SonghaiSenni	1820	j ⁵/o r + k ¹/o j
WARNING 3755: GRANDFATHER	SonghaiSenni	1853	k ¹/aː + ɡ ¹/e
WARNING 3757: GRANDFATHER	ToroTegu	1847	b ¹/a + b ⁵/a
WARNING 3759: GRANDFATHER	BankanTey	1847	p ¹⁵/aː + m
WARNING 3760: GRANDFATHER	Nanga	1847	p ¹/a + w ⁵/a
WARNING 3763: GRANDFATHER	TogoKan	1847	b ¹/a + b ⁵/aː
WARNING 3766: GRANDFATHER	DogulDom	1847	b ¹/aː + b ⁵/aː
WARNING 3767: GRANDFATHER	TebulUre	1847	p ¹/a + p ⁵/a
WARNING 3768: GRANDFATHER	YandaDom	1847	b ¹/a + b ¹/a
WARNING 3770: GRANDFATHER	DonnoSo	1847	b ¹/aː + b ⁵¹/aː
WARNING 3772: GRANDFATHER	Mombo	1847	b ⁵/a + b ⁵/a
WARNING 3774: GRANDFATHER	Fulfulde	1847	m aː + m a
WARNING 3809: GUTS	YandaDom	1876	p ⁵/i d ⁵/i + m
WARNING 3833: HAIR	DonnoSo	1898	k ¹/e ⁿɡ ¹/e + l ⁵/e
WARNING 3852: HAND	YornoSo	1909	n ¹⁵/ɔ + j̃
WARNING 3871: HAND	Bambara	N o n e	b o l o
WARNING 3895: HEAD	SonghaiSenni	1944	b ¹/o + ŋ
WARNING 3923: HEAD	BozoPondorisud	1938	ɲ õ + k w õ
WARNING 3961: HEAVY	DogulDom	1963	d ⁵/o ɡ + s ¹/o
WARNING 3975: HEAVY	Bambara	1957	ɡ ⁵/i r ⁵/ĩ + m ⁵/ã
WARNING 4017: HIDE (CONCEAL)	YandaDom	1983	b ⁵/aː + ⁿd ⁵/ɛ
WARNING 4048: HIP	Gourou	1998	d ¹⁵/ɔ + j̃
WARNING 4049: HIP	Jamsay	1998	d ¹⁵/ɔ + j̃
WARNING 4053: HIP	DogulDom	2002	p ⁵/e + ŋ
WARNING 4058: HIP	DonnoSo	1998	d ¹⁵/o + ŋ
WARNING 4066: HIP	BonduSo	2012	d ⁵/eː + n
WARNING 4069: HONEY	BenTey	2016	j ¹⁵/e + j
WARNING 4075: HONEY	TommoSo	2016	¹/iː + j ⁵/e
WARNING 4077: HONEY	TebulUre	2014	¹/i + d ⁵/e
WARNING 4078: HONEY	YandaDom	2014 2020	¹/i + z ¹/e + ŋ
WARNING 4080: HONEY	Bunoge	2018	ʔ ⁵/i + ɡ ¹/e
WARNING 4082: HONEY	DonnoSo	2018	¹/i + ɡ ⁵/ɛ
WARNING 4083: HONEY	TiranigeDiga	2018	⁵/iː + ɡ ⁵/e
WARNING 4084: HONEY	Mombo	2018	⁵/i + ɡ ¹/e
WARNING 4085: HONEY	Penange	2018	¹/i + ɡ ¹/e
WARNING 4086: HONEY	Bangime	2015	j ³/i + j ¹/ɛ
WARNING 4223: HUNDRED	ToroTegu	2093	z ¹⁵/a + ŋ
WARNING 4230: HUNDRED	YornoSo	2093	s ¹⁵/u + m
WARNING 4237: HUNDRED	Jamsay	2093	s ¹⁵/u + ŋ
WARNING 4267: HUNT	Bangime	198	s ⁵/i s ¹/ɔ ɡ ⁵/ɔ + m ¹/ɛ
WARNING 4292: HUSBAND	BozoDebo	2107	k a i ɡ u + k e p ã n a
WARNING 4315: INJURE	SonghaiSenni	2133	j ⁵/a ⁿɡ ⁵/a + d ⁵¹/a
WARNING 4373: JAW	Jenaama	2150	d ¹/e n + ɡ ¹/e
WARNING 4379: JOINT	BenTey	2165	d ⁵/i j ⁵/a + j
WARNING 4380: JOINT	BankanTey	2165	d ⁵/iː r ⁵/a + j
WARNING 4487: KNEE	PergeTegu	2236	n ¹/i + ⁿɡ ⁵/e
WARNING 4488: KNEE	Gourou	2236	n ¹/e + ŋ ⁵/e
WARNING 4534: KNEEL	YornoSo	2254 2264	t ⁵/u ŋ ⁵/ɛː
WARNING 4851: LIGHT (WEIGHT)	TommoSo	2408	w ⁵/ɛ + j
WARNING 4856: LIGHT (WEIGHT)	DonnoSo	2408	w ¹⁵/ɛ + j
WARNING 4906: LION	TiranigeDiga	2430	d ⁵/u ŋ + ɡ ⁵/a
WARNING 4928: LOCK	BonduSo	2453	k ⁵/u f ⁵/a + r ¹/u
WARNING 5059: LUNCH	BozoPondorinord	2528	j ¹/i r ¹/a + x ¹/a t ⁵/a
WARNING 5089: LUNG	Bambara	236	f o ɡ o n + f o ɡ o n
WARNING 5112: MAIZE	BozoDebo	2564	d a r ã + m a dʒ ∼/ɛ ŋ
WARNING 5116: MAIZE	BozoKorondougousud	2564	dʒ ã m a + dʒ e õ
WARNING 5225: MARRY	Bunoge	2618	k ⁵/e l + d ¹/e
WARNING 5233: MARRY	SonghaiSenni	2617	k ¹/u b ⁵¹/e + j
WARNING 5242: MAT	DogulDom	2635	n ¹⁵/iː + ŋ
WARNING 5243: MAT	YandaDom	2635	n ¹/i + ŋ
WARNING 5255: MAT	TebulUre	2635	n ¹/i + ⁿɡ ⁵/e
WARNING 5270: MEAL	BenTey	2640	ɲ ¹⁵/ɛ + j̃
WARNING 5465: MOON	BonduSo	2722	s ¹/aː + ɡ ⁵/e
WARNING 5538: MOUSE	Gourou	2764	¹/u + s ¹/u w̃ ⁵/o
WARNING 5545: MOUSE	TebulUre	2757	⁵/o + ⁵/e
WARNING 5601: MUD	Penange	2796	¹/ɔ ɡ ¹/ɔ + l ¹/ɔ
WARNING 5633: NAME	ToroSo	2808	b ⁵/o + j
WARNING 5834: NINE	BonduSo	2905	t w ⁵¹/a + j
WARNING 5962: OLD	ToroTegu	2966 2973	p ¹/a + j + n ⁵/u
WARNING 5963: OLD	YandaDom	2966	p ¹/ɛ + j
WARNING 5964: OLD	YornoSo	2966	p ¹⁵/ɛ + j
WARNING 5967: OLD	TiranigeDiga	2966	b ⁵/a + j
WARNING 5968: OLD	Jamsay	2966	p ¹⁵/ɛ + j̃
WARNING 6189: PENIS	Bangime	3110	j ⁵/o ⁿb ⁵/o + r ¹/o
WARNING 6355: PLACE (POSITION	Fulfulde	3209	w aː l d + u d e
WARNING 6523: RAIN (PRECIPITA	YandaDom	3281	¹/a ∼/r̃ ¹/u + ŋ
WARNING 6655: RING	Jenaama	3366	d ¹/ɔ l ³/u + ⁿb ³/e
WARNING 6721: ROOT	Soninke	3419	ɲ ¹/i: + m ⁵¹/e
WARNING 6793: ROTTEN	ToroSo	3435 3436	¹/i l ¹/aː + ɡ ⁵/a b ⁵/a + j
WARNING 6810: ROUGH	Mombo	3444	j ⁵/a ɡ ⁵/a + r ⁵/a
WARNING 6891: SAND	Jenaama	3476	s ɔ̃ + s ɔ̃
WARNING 6896: SAND	BozoKotya	3476	tʃ ɔ̃ + tʃ ɔ̃
WARNING 6897: SAND	BozoTiemaCewe	3485	k ∼/ɛ: + ɲ ∼/ɛ
WARNING 6898: SAND	BozoDebo	3483	s õ + s õ
WARNING 6899: SAND	BozoKorondougounord	3483	s ĩ ẽ + s i õ
WARNING 6900: SAND	BozoKorondougousud	3483	s ĩ ∼/ɛ + s ĩ õ
WARNING 6902: SAND	Soninke	3492	s ¹/e j ⁵/e ŋ + ŋ ¹/e
WARNING 6903: SAND	ToroTegu	3474 3479	¹/i s ¹/o + s ⁵/u m ¹⁵/e + j
WARNING 6907: SAND	PergeTegu	3474 3480	s ¹/u + s ¹⁵/u + m
WARNING 6908: SAND	Gourou	3474 3480	s ¹/i + s ¹⁵/ɔ + m
WARNING 6909: SAND	YornoSo	3474 3480	s ¹/u + s ¹⁵/o + m
WARNING 6924: SAND	TogoKan	3481	s ¹/ɔ̃ + s ¹/ɔ n ⁵/ɔ
WARNING 6925: SAND	Bambara	3476	tʃ ∼/ɛ + tʃ ∼/ɛ
WARNING 7016: SEE	ToroSo	3522	¹/i + j ¹/e
WARNING 7099: SEVEN	BozoTiemaCewe	3558	d i o + dʒ ∼/ɛ: n i
WARNING 7104: SEVEN	Bambara	3556	w ⁵/o l ⁵/õ + w ¹/u l ⁵/a
WARNING 7117: SEW	BenTey	3565	k ⁵/u + j ⁵/o
WARNING 7124: SEW	TebulUre	3573	p ⁵/ɛː + j
WARNING 7127: SEW	Mombo	3565	k ⁵/u + j ⁵/e
WARNING 7128: SEW	BonduSo	3566	k ⁵/o + j
WARNING 7138: SEW	BonduSo	3566	k ⁵/o + j
WARNING 7143: SHARP	BenTey	3581	j ⁵/a ɡ u + m
WARNING 7298: SHORT	SonghaiSenni	3665	d ⁵/u ⁿɡ ⁵/u + r ⁵/i + j ⁵/a
WARNING 7457: SIT	ToroSo	3722 3726	d ¹/a j̃ ⁵/ɛ
WARNING 7509: SKIN	Bangime	354	k ¹/i + ⁿɡ ¹/ɛ
WARNING 7537: SKY	Bunoge	3763 3764	ʔ ⁵/a + ⁿk ⁵/o + ⁿɡ ¹/o
WARNING 7556: SKY	Bambara	3753	s ɑ n + k o l o
WARNING 7620: SLEEP	ToroSo	3790	j ¹/e + j ⁵/i
WARNING 7622: SLEEP	BonduSo	3790	n ⁵/o + j ⁵/iː
WARNING 7650: SMALL	Bunoge	3813 3816	d ¹/aː ᵐb ¹/e
WARNING 7723: SMOKE	Bangime	360	k ¹/o k ¹/o + m ⁵/ɔ
WARNING 7736: SMOOTH	BankanTey	3845	⁵/o r ¹/u + m
WARNING 7739: SMOOTH	DogulDom	3847 3852	⁵/ɔ n ¹/ɔ + n ¹/ɔ + ŋ
WARNING 7740: SMOOTH	Gourou	3855	¹/o n ¹/u + r ⁵/u
WARNING 7741: SMOOTH	BonduSo	3847 3848	⁵/o n ¹/a + n ¹/a + ⁵/o n ¹/+ a n ¹/ɛː
WARNING 7743: SMOOTH	TebulUre	3847	⁵/ɔ ∼/r̃ ⁵/ɔ + n ¹/ɛː
WARNING 7744: SMOOTH	TogoKan	3847	¹/ɔ ∼/r̃ ⁵/ɔ n + ⁵/ɔ n ⁵/ɔ
WARNING 7745: SMOOTH	TommoSo	3845	¹/ɔ r ¹⁵/ɔ + j
WARNING 7747: SMOOTH	YandaDom	3845	¹/ɔ ∼/r̃ ¹/ɔ + ⁿd ⁵/u
WARNING 7748: SMOOTH	YornoSo	3845	⁵/ɔ r ¹/ɔ + j
WARNING 7749: SMOOTH	DonnoSo	3847	⁵/ɔ n ¹/ɔ + n ¹/ɔ
WARNING 7750: SMOOTH	Jamsay	3855	¹/o n ¹/u + ∼/r̃ ⁵/u
WARNING 7751: SMOOTH	Mombo	3847	⁵/ɔ n ⁵/ɔ + n ⁵/ɔ
WARNING 7752: SMOOTH	Penange	3847	¹/ɔ n ¹/a + n ¹/a
WARNING 7753: SMOOTH	TiranigeDiga	3849	b ⁵/u r ⁵/a + d ⁵/a
WARNING 7754: SMOOTH	PergeTegu	3845	⁵/o r ¹/u + m
WARNING 7761: SNAKE	BozoHainyaxo	3872	n ɛ ɡ ɛ + f ɔː
WARNING 7804: SOAP	BankanTey	3895	s ¹/a p p ⁵/i + n ¹/a
WARNING 7805: SOAP	Nanga	3896	s ¹/a m ⁵/i + ∼/r̃ ⁵¹/i
WARNING 7959: SPIT	SonghaiSenni	365	t ⁵/u f ⁵¹/e + j
WARNING 7982: SPLEEN	ToroTegu	3999 3991	tʃ ⁵/ɛ l ⁵/a + ⁿp ⁵/a r ¹/e + j
WARNING 7983: SPLEEN	BenTey	3992 3991	k ¹/ɛ l ¹/ɛ + p ¹⁵/aː l ¹/a + j
WARNING 7995: SPLEEN	Jamsay	3999 3991	tʃ ¹/ɛ n ¹/ɛ + p ¹⁵/aː l ¹/a + m
WARNING 8005: SPRING OR WELL	BankanTey	4010	d ¹⁵/a + j̃
WARNING 8006: SPRING OR WELL	PergeTegu	4018	¹/ɛ + k ⁵/ɔ r ⁵/ɔ
WARNING 8020: SPRING OR WELL	Fulfulde	4013	ɓ u n + ⁿd u
WARNING 8023: STAR	ToroTegu	4038	s ⁵/e m r ¹⁵/e + j
WARNING 8034: STAR	Bunoge	4029	dʒ ∼⁵/ɔ ɡ ⁵/u + l ¹/ɛ
WARNING 8095: STOMACH	PergeTegu	4058	b ¹/i ⁿɡ ⁵/i + r ¹/i
WARNING 8199: SUN	Fulfulde	4111	n aː + ⁿɡ e
WARNING 8202: SUN	Mombo	4103	ɡ ⁵/eː + w̃ ¹/e
WARNING 8204: SUN	TommoSo	4105	n ¹⁵/a + m
WARNING 8205: SUN	YornoSo	4105	n ¹⁵/a + m
WARNING 8217: SUN	ToroSo	4105	n ¹⁵/a + j
WARNING 8266: SWEEP	Mombo	4139	ɡ ⁵/ɛ + ⁿj ⁵¹/ɛː
WARNING 8276: SWEET	BenTey	4151	⁵/ɛ r i + m
WARNING 8278: SWEET	TommoSo	4149	⁵/ɛ l ⁵/ɛ + l ⁵/u
WARNING 8291: SWEET	Bangime	4148	d ¹/e + j
WARNING 8376: TALK	Penange	4210 4211	⁵/a t t ⁵¹/eː + ɡ ⁵/o l + ɡ ¹/e
WARNING 8383: TASTE	Bambara	4221	s ⁵/i d ⁵/ɛ + ɡ ⁵/ɛ̃
WARNING 8397: TEN	Bunoge	4229	k ⁵/o b ⁵/e + w̃
WARNING 8399: TEN	TiranigeDiga	4224	p ¹/i j ¹/ɔ + l ¹/u
WARNING 8404: TEN	Jenaama	4226	tʃ ³/ɛ: + m
WARNING 8440: TESTICLES	TiranigeDiga	4246	s ¹/e ɡ ¹/e + l ¹/e
WARNING 8442: TESTICLES	Penange	4238	p ∼⁵/ɔ t ⁵/ɛ + r ¹/ɛ
WARNING 8452: THICK	BankanTey	4248	k ⁵/a w̃ ⁵/a + w̃
WARNING 8461: THICK	PergeTegu	4259	d ⁵/e m + d ⁵/e
WARNING 8526: THING	DonnoSo	4282	k ¹/i + d ⁵/ɛ
WARNING 8560: THINK	BonduSo	4297	k ⁵/a dʒ ⁵/a + b i
WARNING 8563: THINK	ToroTegu	4305	n ⁵/ɔ ŋ ⁵/u + s ⁵/u
WARNING 8568: THORN	BankanTey	4313	d ¹/o + r ⁵/o
WARNING 8569: THORN	Nanga	4313	d ¹/u + r ⁵/o
WARNING 8571: THORN	Gourou	4313	d ¹/i + d ⁵/oː
WARNING 8574: THORN	TommoSo	4322	ɡ ⁵/i + j ⁵/e
WARNING 8576: THORN	YandaDom	4322	z ¹/i + j ¹/e
WARNING 8590: THORN	BozoHainyaxo	4314	s ∼/ɛ: + ɲ ɛ
WARNING 8596: THORN	BozoTieyaxo	4314	s ĩ ∼/ɛ + ɲ ∼/ɛ
WARNING 8598: THORN	Soninke	4314	s ⁵/a: + s ¹/e
WARNING 8646: THROAT	TomoKan	4334	k ¹/o r + ¹/o d ¹/o
WARNING 8648: THROAT	Penange	4344	⁵/o r ⁵/e + ɡ ⁵/e l ¹/e
WARNING 8651: THROAT	Mombo	4341 4342	¹/o l ¹/o + l ¹/i + p ⁵/i dʒ ⁵/i
WARNING 8725: TOE	DogulDom	4385 4383	n ¹/aː + ɡ + s ⁵¹/a j + ɡ
WARNING 8728: TOE	BonduSo	4384	n ¹/aː + s ⁵/ɛ ⁿd ¹/ɔː
WARNING 8729: TOE	Bunoge	4382	s ¹/eː + s ⁵/e
WARNING 8733: TOE	TiranigeDiga	4396 4383	t ¹/o ⁿdʒ ¹/e + s ¹/e + ⁿɡ ⁵/e
WARNING 8734: TOE	Mombo	4382	s ⁵/iː + s ¹/iː
WARNING 8764: TONGS	Fulfulde	394	k a ⁿp aː + dʒ e
WARNING 8868: TRAP (PITFALL)	ToroTegu	4462	k ⁵/u s ¹⁵/e + j
WARNING 8881: TRAP (PITFALL)	Mombo	4471	m ⁵/a s ⁵/a + w̃
WARNING 8884: TRAP (PITFALL)	Fulfulde	94	d i b iː + r e
WARNING 8941: TREE	DonnoSo	4494	t ¹/i m + m ⁵/ɛ
WARNING 8955: TROUGH	Bunoge	4504	ʔ ¹/a ɡ ¹/a l ¹/aː + w ⁵/o
WARNING 8957: TROUGH	Mombo	4507	t ⁵/o ⁿɡ ⁵/o + l ¹/o
WARNING 8958: TROUGH	Penange	4507	t ⁵/o ⁿɡ ⁵/o + l ⁵/o
WARNING 8960: TROUGH	Fulfulde	4505	w a l k + aː r e
WARNING 9021: TWO	DogulDom	4551	n ⁵/eː + ɡ ¹/e
WARNING 9028: TWO	TiranigeDiga	4551	n ¹/iː + ⁿɡ ¹/a
WARNING 9030: TWO	Penange	4551	n ¹/e + ɡ ¹/a
WARNING 9196: WATER	DogulDom	4627	n + ɲ ¹/u
WARNING 9197: WATER	DogulDom	4631	ʔ + ɲ ¹/i
WARNING 9198: WATER	TebulUre	4624	⁵/i + ⁿdʒ ⁵/e
WARNING 9199: WATER	YandaDom	4624	⁵/i + ⁿdʒ ⁵/u
WARNING 9260: WEEK	TommoSo	4651 4652	b ¹/a j + s ¹⁵/ɔ + j
WARNING 9295: WET	BankanTey	4657	¹/ɔ r ⁵/u + m
WARNING 9298: WET	Jamsay	4655	t ¹⁵/ɛ + m
WARNING 9398: WING	Soninke	416 4720	k ⁵/a ⁿp ¹/e
WARNING 9436: WOMAN	Soninke	4739	j ¹/a x ¹/a + r ⁵¹/e
WARNING 9514: WORK (LABOUR)	SonghaiSenni	423	ɡ ⁵/o + j
WARNING 9602: YELLOW	Gourou	4796	s ⁵/a + j
WARNING 9617: YELLOW	Fulfulde	4800	oː l + o l
WARNING 9630: MARRY	Bangime	242	b ³/u + w ¹/ɔ
WARNING 9632: SEND	Bangime	330	t ³/u n + d ¹/o

[IndianaTones]

Good - thank you for the list - working through it now.

[XachaB]

Thank for the answers and for taking care of this !

Now I have a new question: How should I, in general in Lexibank datasets, check for expert cogid(s) ? How can I know whether the present IDs are expert annotations or automatically deduced ?

This is important for me, as I want to use the manual/expert annotations as a validation for the cognate detection in the sound correspondence study. But of course, if I mistake automated cogids for expert cogids, then my evals will have no value !

So far, I was making the false assumption that whever cogid(s) were in the data, they were expert annotations !

[IndianaTones]

Thank you @XachaB for pointing this out as I would not have seen it!

This is a good question, better answered by @LinguList, but in the meantime I will say that for this dataset the only way I keep track of the changes I make is that I can compare the differences between the Edictor version and the original. That is, I begin with the automatically detected COGID(s) and BORID and then go through every entry and adjust as needed, but only on Edictor so as not to change the 'original' as it were.

[LinguList]

@XachaB, datasets with cognates are those which we call CogCore in lexibank. This very dataset is in fact not even part of Lexibank, so it should also not be used. I recommend to restrict the analysis to all lexicore datasets in lexibank, which have a reasonable amount of mutual coverage > 150 to be used with lexstat/lingrex/corpar. This coverage analysis is what I'd recommend to carry out initially, on lexicore datasets for individual language families. We did not list baf2 in lexibank.csv, since it is a dataset we are still working on, with cognate sets derived via using lexstat, and not checked for correspondences.

[IndianaTones]

btw - git cloned everything and opened new venv but still get a warning and an error from cldfbench download lexibank_baf2.py:

UserWarning: ImportError loading entry point languageislands warnings.warn('ImportError loading entry point {0.name}'.format(ep)) ERROR: Invalid dataset spec: <cldfbench.dataset> lexibank_baf2.py

[LinguList]

The fact that your code gives an import error for langaugeislands, a code which we do not use here, shows that you are most likely using the wrong environment. Did you run pip install -e . in the baf2 folder?

[LinguList]

WARNING  651: BLANKET         | TogoKan              | 352 364    | j ¹/aː t ¹⁵/ũ
WARNING  698: BLOOD           | TommoSo              | 397        | ¹/i l ¹/i + j ⁵/e
WARNING 1445: CLOUD           | Nanga                | 757 743    | j ¹/a r + k ¹/u m ¹/u + r̃ ⁵/a
WARNING 3175: FOLD            | BankanTey            | 1576 1577  | ⁿb ¹/u ⁿd ⁵/o
WARNING 7761: SNAKE           | BozoHainyaxo         | 3872       | n ɛ ɡ ɛ + f ɔː
WARNING 8725: TOE             | DogulDom             | 4385 4383  | n ¹/aː + ɡ + s ⁵¹/a j + ɡ

Some five errors left there.

[IndianaTones]

Thank you, something weird going on on my end, I fixed these. Will do the sound errors now.