2x2 contingency table with the following contents: a: tb[0, 0]: # of samples that both models predicted correctly b: tb[0, 1]: # of samples that model 1 got right and model 2 got wrong c: tb[1, 0]: # of samples that model 2 got right and model 1 got wrong d: tb[1, 1]: # of samples that both models predicted incorrectly
4 (tb[0, 0], a) is # of samples that model 1 and 2 got right
1 (tb[0, 1], b) is # of samples that model 1 got right and model 2 got wrong
2 (tb[1, 0], c) is # of samples that model 2 got right and model 1 got wrong
3 (tb[1, 1], d) is # of samples that model 1 and 2 got wrong
Suggest a potential improvement or addition
I think that reversing each labels will work.
brd = checkerboard_plot(tb,
figsize=(3, 3),
fmt='%d',
col_labels=['model 2 right', 'model 2 wrong'], # As is: ['model 2 wrong', 'model 2 right']
row_labels=['model 1 right', 'model 1 wrong']) # As is: ['model 1 wrong', 'model 1 right']
Describe the documentation issue
https://rasbt.github.io/mlxtend/user_guide/evaluate/mcnemar_table/#example-2-2x2-contingency-table
The labels of the checkerboard plot do not seem to match the description of the returned value
tb
isfrom returns in https://rasbt.github.io/mlxtend/user_guide/evaluate/mcnemar_table/#api
tb[0, 0]
, a) is # of samples that model 1 and 2 got righttb[0, 1]
, b) is # of samples that model 1 got right and model 2 got wrongtb[1, 0]
, c) is # of samples that model 2 got right and model 1 got wrongtb[1, 1]
, d) is # of samples that model 1 and 2 got wrongSuggest a potential improvement or addition
I think that reversing each labels will work.