Incorporate user quality score to determine consensus label

v3nd3774 / bipartiteGraphNodeMysqlDemo

Repository to store code for research demo related to machine learning labeling data exploration and visualization system.

https://idir.uta.edu/bipartiteGraphUi/

MIT License

0 stars 0 forks source link

Open v3nd3774 opened 7 months ago

v3nd3774 commented 7 months ago

Enable use of several algorithms to determine consensus label for an item on the RHS of the bipartite graph;

(Default) Simple voting where each node in LHS gets 1 vote and simple majority wins or in the event of a tie the winner is the first occurring label in alphabetical order.
User quality score - Weighted voting where each LHS node is weighted by the user quality score, the user quality column must be provided for this to run.

Also requires rendering consensus label in the data table.

v3nd3774 commented 7 months ago

Consensus label table exists; use this data from here or the query used to generate the label. Either way, add this information to the web app.

v3nd3774 commented 7 months ago

Joey can help with this information.

v3nd3774 commented 7 months ago

Consensus showing up with a -1; this is not accurate so should chat with Joey on how to avoid this.

v3nd3774 commented 6 months ago

-2 is the most high quality measure after speaking with Dr. Li; the higher the positive integer the worse quality.

v3nd3774 commented 5 months ago

Consensus label should not consider skip label as a valid label to form consensus around.