Open matthew-cheney opened 4 years ago
This looks like the most well-built glicko2 module. It's linked to from the creator's website (http://www.glicko.net/glicko.html) https://code.google.com/archive/p/pyglicko2/source/default/source
https://en.wikipedia.org/wiki/Stochastic_transitivity
This article has some footnotes to some very recent work on this:
Shah, Nihar B.; Balakrishnan, Sivaraman; Guntuboyina, Adityanand; Wainwright, Martin J. (February 2017). "Stochastically Transitive Models for Pairwise Comparisons: Statistical and Computational Issues". IEEE Transactions on Information Theory. 63 (2): 934–959. doi:10.1109/tit.2016.2634418. ISSN 0018-9448.
Chatterjee, Sabyasachi; Mukherjee, Sumit (June 2019). "Estimation in Tournaments and Graphs Under Monotonicity Constraints". IEEE Transactions on Information Theory. 65 (6): 3525–3539. arXiv:1603.04556. doi:10.1109/tit.2019.2893911. ISSN 0018-9448.
Oliveira, Ivo F.D.; Ailon, Nir; Davidov, Ori (2018). "A New and Flexible Approach to the Analysis of Paired Comparison Data". Journal of Machine Learning Research. 19: 1–29.
It also occurred to me that we might get some inspiration from the active learning
community. Something like this paper would be great, especially if they shared their code. :-)
https://www.cs.cmu.edu/~jgc/publication/PublicationPDF/Active_Sampling_For_Rank_Learning_Via_Optimizing_The_Area_Under_The_ROC_Curve.pdf
The Bradley-Terry model has a well-maintained implementation here: https://github.com/lucasmaystre/choix
The author made a great notebook explaining how to use it: https://github.com/lucasmaystre/choix/blob/master/notebooks/intro-pairwise.ipynb
https://en.wikipedia.org/wiki/Bradley%E2%80%93Terry_model https://en.wikipedia.org/wiki/Ordinal_regression https://en.wikipedia.org/wiki/Rasch_model https://en.wikipedia.org/wiki/Scale_(social_sciences)#Comparative_scaling_techniques https://en.wikipedia.org/wiki/Elo_rating_system https://en.wikipedia.org/wiki/Thurstonian_model https://en.wikipedia.org/wiki/Glicko_rating_system https://github.com/deepy/glicko2 Python Glicko-2 implementation. https://github.com/sublee/glicko2 Python Glicko-2 implementation.