Open matthew-cheney opened 4 years ago
matthew-cheney
commented
4 years ago This looks like the most well-built glicko2 module. It's linked to from the creator's website (http://www.glicko.net/glicko.html) https://code.google.com/archive/p/pyglicko2/source/default/source
reynoldsnlp
commented
4 years ago https://en.wikipedia.org/wiki/Stochastic_transitivity
This article has some footnotes to some very recent work on this:
Shah, Nihar B.; Balakrishnan, Sivaraman; Guntuboyina, Adityanand; Wainwright, Martin J. (February 2017). "Stochastically Transitive Models for Pairwise Comparisons: Statistical and Computational Issues". IEEE Transactions on Information Theory. 63 (2): 934–959. doi:10.1109/tit.2016.2634418. ISSN 0018-9448.
Chatterjee, Sabyasachi; Mukherjee, Sumit (June 2019). "Estimation in Tournaments and Graphs Under Monotonicity Constraints". IEEE Transactions on Information Theory. 65 (6): 3525–3539. arXiv:1603.04556. doi:10.1109/tit.2019.2893911. ISSN 0018-9448.
Oliveira, Ivo F.D.; Ailon, Nir; Davidov, Ori (2018). "A New and Flexible Approach to the Analysis of Paired Comparison Data". Journal of Machine Learning Research. 19: 1–29.
reynoldsnlp
commented
4 years ago It also occurred to me that we might get some inspiration from the active learning community. Something like this paper would be great, especially if they shared their code. :-)
https://www.cs.cmu.edu/~jgc/publication/PublicationPDF/Active_Sampling_For_Rank_Learning_Via_Optimizing_The_Area_Under_The_ROC_Curve.pdf
reynoldsnlp
commented
4 years ago The Bradley-Terry model has a well-maintained implementation here: https://github.com/lucasmaystre/choix
The author made a great notebook explaining how to use it: https://github.com/lucasmaystre/choix/blob/master/notebooks/intro-pairwise.ipynb
https://en.wikipedia.org/wiki/Bradley%E2%80%93Terry_model https://en.wikipedia.org/wiki/Ordinal_regression https://en.wikipedia.org/wiki/Rasch_model https://en.wikipedia.org/wiki/Scale_(social_sciences)#Comparative_scaling_techniques https://en.wikipedia.org/wiki/Elo_rating_system https://en.wikipedia.org/wiki/Thurstonian_model https://en.wikipedia.org/wiki/Glicko_rating_system https://github.com/deepy/glicko2 Python Glicko-2 implementation. https://github.com/sublee/glicko2 Python Glicko-2 implementation.