asreview / asreview-insights

Tools such as plots and metrics to analyze (simulated) reviews for ASReview LAB
https://www.asreview.ai
Apache License 2.0
28 stars 13 forks source link

Add option to output model settings in metric output #39

Open J535D165 opened 2 years ago

J535D165 commented 2 years ago

It would be nice to extend the asreview metrics command with model settings. Ideally with a flag that is disabled by default.

Example:

asreview metrics my_file.asreview --include-metrics
 "asreviewVersion": "1.0",
    "apiVersion": "1.0",
    "model": {
          ...
    }
    "data": {
        "items": [
            {
                "id": "recall",
                "title": "Recall",
                "value": [
                    [
                        0.1,
                        1.0
                    ],
                    [
                        0.25,
                        1.0
                    ],
                    [
                        0.5,
                        1.0
                    ],
                    [
                        0.75,
                        1.0
                    ],
                    [
                        0.9,
                        1.0
                    ]
                ]
            },
            {
                "id": "wss",
                "title": "Work Saved over Sampling",
                "value": [
                    [
                        0.95,
                        0.8913851624373686
                    ]
                ]
            },
            {
                "id": "erf",
                "title": "Extra Relevant record Found",
                "value": [
                    [
                        0.1,
                        0.9047619047619048
                    ]
                ]
            },
            {
                "id": "atd",
                "title": "Average time to discovery",
                "value": 101.71428571428571
            },
            {
                "id": "td",
                "title": "Time to discovery",
                "value": [
                    [
                        3898,
                        22
                    ],
                    [
                        284,
                        23
                    ],
                    [
                        592,
                        25
                    ],
                    ...
                    [
                        2382,
                        184
                    ],
                    [
                        5479,
                        224
                    ],
                    [
                        3316,
                        575
                    ]
                ]
            }
        ]
    }
}