IBM / zshot

Zero and Few shot named entity & relationships recognition
https://ibm.github.io/zshot
MIT License
350 stars 20 forks source link

Fix/relation extractor evaluation #39

Closed GabrielePicco closed 1 year ago

GabrielePicco commented 1 year ago
Status Type ⚠️ Core Change Issue
Ready Bug No

Problem

Solution

codecov[bot] commented 1 year ago

Codecov Report

Base: 92.18% // Head: 92.20% // Increases project coverage by +0.02% :tada:

Coverage data is based on head (c078a98) compared to base (2a84de0). Patch coverage: 91.66% of modified lines in pull request are covered.

:exclamation: Current head c078a98 differs from pull request most recent head 9742e6e. Consider uploading reports for the commit 9742e6e to get more accurate results

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #39 +/- ## ========================================== + Coverage 92.18% 92.20% +0.02% ========================================== Files 67 67 Lines 2763 2758 -5 ========================================== - Hits 2547 2543 -4 + Misses 216 215 -1 ``` | [Impacted Files](https://codecov.io/gh/IBM/zshot/pull/39?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=IBM) | Coverage Δ | | |---|---|---| | [...hot/relation\_extractor/zsrc/zero\_shot\_rel\_class.py](https://codecov.io/gh/IBM/zshot/pull/39/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=IBM#diff-enNob3QvcmVsYXRpb25fZXh0cmFjdG9yL3pzcmMvemVyb19zaG90X3JlbF9jbGFzcy5weQ==) | `78.89% <0.00%> (-0.74%)` | :arrow_down: | | [zshot/evaluation/dataset/fewrel/fewrel.py](https://codecov.io/gh/IBM/zshot/pull/39/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=IBM#diff-enNob3QvZXZhbHVhdGlvbi9kYXRhc2V0L2Zld3JlbC9mZXdyZWwucHk=) | `96.96% <100.00%> (+4.11%)` | :arrow_up: | | [...ot/evaluation/dataset/med\_mentions/med\_mentions.py](https://codecov.io/gh/IBM/zshot/pull/39/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=IBM#diff-enNob3QvZXZhbHVhdGlvbi9kYXRhc2V0L21lZF9tZW50aW9ucy9tZWRfbWVudGlvbnMucHk=) | `100.00% <100.00%> (ø)` | | | [zshot/evaluation/pipeline.py](https://codecov.io/gh/IBM/zshot/pull/39/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=IBM#diff-enNob3QvZXZhbHVhdGlvbi9waXBlbGluZS5weQ==) | `100.00% <100.00%> (ø)` | | | [zshot/linker/linker\_smxm.py](https://codecov.io/gh/IBM/zshot/pull/39/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=IBM#diff-enNob3QvbGlua2VyL2xpbmtlcl9zbXhtLnB5) | `96.77% <100.00%> (+0.10%)` | :arrow_up: | | [...shot/mentions\_extractor/mentions\_extractor\_smxm.py](https://codecov.io/gh/IBM/zshot/pull/39/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=IBM#diff-enNob3QvbWVudGlvbnNfZXh0cmFjdG9yL21lbnRpb25zX2V4dHJhY3Rvcl9zbXhtLnB5) | `100.00% <100.00%> (ø)` | | | [zshot/tests/evaluation/test\_datasets.py](https://codecov.io/gh/IBM/zshot/pull/39/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=IBM#diff-enNob3QvdGVzdHMvZXZhbHVhdGlvbi90ZXN0X2RhdGFzZXRzLnB5) | `100.00% <100.00%> (ø)` | | | [zshot/tests/evaluation/test\_evaluation.py](https://codecov.io/gh/IBM/zshot/pull/39/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=IBM#diff-enNob3QvdGVzdHMvZXZhbHVhdGlvbi90ZXN0X2V2YWx1YXRpb24ucHk=) | `99.46% <100.00%> (+<0.01%)` | :arrow_up: | Help us with your feedback. Take ten seconds to tell us [how you rate us](https://about.codecov.io/nps?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=IBM). Have a feature suggestion? [Share it here.](https://app.codecov.io/gh/feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=IBM)

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.