search

openvinotoolkit / openvino_xai

OpenVINO™ Explainable AI (XAI) Toolkit: Visual Explanation for OpenVINO Models
https://openvinotoolkit.github.io/openvino_xai/
Apache License 2.0
29 stars 9 forks source link

Update hyperparameters of bb methods #65

Closed negvet closed 2 months ago

negvet commented 2 months ago

For the reference maps, see https://github.com/openvinotoolkit/openvino_xai/pull/63

Future work: measure metrics

GalyaZalesskaya commented 2 months ago

Did you update presets using metrics or manually checking quality of the saliency maps in #63?

Also, the table of contents for some reason doesn't show the inner structure of XAI overview methods. Can you check what went wrong there, please? image

negvet commented 2 months ago

Did you update presets using metrics or manually checking quality of the saliency maps in https://github.com/openvinotoolkit/openvino_xai/pull/63?

I have not used metrics, just qualitative assessment for now. Quantitative analysis is in TODO list

negvet commented 2 months ago

Also, the table of contents for some reason doesn't show the inner structure of XAI overview methods. Can you check what went wrong there, please?

This is intentional. Do you think we need it? Probably it will be too long, what do you think? May be the main subsections only..

GalyaZalesskaya commented 2 months ago

Also, the table of contents for some reason doesn't show the inner structure of XAI overview methods. Can you check what went wrong there, please?

This is intentional. Do you think we need it? Probably it will be too long, what do you think? May be the main subsections only..

Let's make it for inly main subsections: white-box and black box

negvet commented 2 months ago

Let's make it for inly main subsections: white-box and black box

Done

codecov[bot] commented 2 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 94.31%. Comparing base (a95e871) to head (7a5a69e). Report is 1 commits behind head on releases/1.1.0.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## releases/1.1.0 #65 +/- ## ================================================== + Coverage 94.29% 94.31% +0.01% ================================================== Files 27 27 Lines 1857 1863 +6 ================================================== + Hits 1751 1757 +6 Misses 106 106 ``` | [Flag](https://app.codecov.io/gh/openvinotoolkit/openvino_xai/pull/65/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=openvinotoolkit) | Coverage Δ | | |---|---|---| | [dev-py310](https://app.codecov.io/gh/openvinotoolkit/openvino_xai/pull/65/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=openvinotoolkit) | `94.31% <100.00%> (+0.01%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=openvinotoolkit#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.