search

IBM / zshot

Zero and Few shot named entity & relationships recognition
https://ibm.github.io/zshot
MIT License
350 stars 20 forks source link

:bug: Fix evaluation #51

Closed marmg closed 1 year ago

marmg commented 1 year ago
Status Type ⚠️ Core Change Issue
Ready Bug No Link

Problem

The parameter ignore_verifications is deprecated in datasets 2.9.1 and will be removed in 3.0.0.

Solution

Replace the parameter ignore_verifications with verification_mode='no_checks'

Other changes (e.g. bug fixes, small refactors)

New dependencies:

Closes #50

codecov[bot] commented 1 year ago

Codecov Report

Patch coverage: 100.00% and project coverage change: -0.04 :warning:

Comparison is base (cf95be0) 93.04% compared to head (8c2acec) 93.00%.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #51 +/- ## ========================================== - Coverage 93.04% 93.00% -0.04% ========================================== Files 67 67 Lines 2832 2832 ========================================== - Hits 2635 2634 -1 - Misses 197 198 +1 ``` | [Impacted Files](https://codecov.io/gh/IBM/zshot/pull/51?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=IBM) | Coverage Δ | | |---|---|---| | [zshot/evaluation/dataset/ontonotes/onto\_notes.py](https://codecov.io/gh/IBM/zshot/pull/51?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=IBM#diff-enNob3QvZXZhbHVhdGlvbi9kYXRhc2V0L29udG9ub3Rlcy9vbnRvX25vdGVzLnB5) | `71.18% <100.00%> (ø)` | | ... and [1 file with indirect coverage changes](https://codecov.io/gh/IBM/zshot/pull/51/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=IBM) Help us with your feedback. Take ten seconds to tell us [how you rate us](https://about.codecov.io/nps?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=IBM). Have a feature suggestion? [Share it here.](https://app.codecov.io/gh/feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=IBM)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.