biolab / orange3

🍊 :bar_chart: :bulb: Orange: Interactive data analysis
https://orangedatamining.com
Other
4.81k stars 1k forks source link

How to create 'Evaluation Result' directly from 'Table' data? #6813

Open xianglun918 opened 4 months ago

xianglun918 commented 4 months ago

Many analysis widgets in Orange are expecting 'Evaluation Results' as inputs. I need to analyze on results of a complicated DNN, and find that it is hard to generate 'Evaluation Results' based on model's output csv files.

How can I transform 'Table' directly to 'Evaluation Results', say 'Table' already has categorical features including 'true lable' and 'predictions'?

Something Like: image

janezd commented 4 months ago

You can't. Evaluation results is not just a table but a more complicated structure, which also contains other data like subset indices, models etc.

xianglun918 commented 4 months ago

Understood. Maybe we can have a new widget which mocks 'Evaluation Results' with only 'Table data'? It would be great if Orange can be used to analyze on Pytorch or tensorflow model's results. Many evaluation widgets are verfy useful.

xianglun918 commented 4 months ago

Something like this :) image

janezd commented 4 months ago

@BlazZupan suggested that we could have a classifier that "predicts" based on values from a column. If the column is numeric, it can also apply logistic function.