JohnSnowLabs / langtest

Deliver safe & effective language models

http://langtest.org/

Apache License 2.0

488 stars 36 forks source link

Renaming sub task #970

Closed Prikshit7766 closed 7 months ago

Prikshit7766 commented 7 months ago

Description

This PR standardizes the category names for sub-tasks:

sycophancy
factuality
sensitivity
legal
clinical
disinformation

These names provide clarity and consistency across the project's sub-tasks.

Additionally in sensitivity category we have renamed the supported test to avoid confusion.

toxicity - > add_toxic_words negation - > add_negation

➤ Fixes # (issue)

Type of change

Please delete options that are not relevant.

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

Usage

Checklist:

[ ] I've added Google style docstrings to my code.
[ ] I've used pydantic for typing when/where necessary.
[ ] I have linted my code
[ ] I have added tests to cover my changes.

Screenshots (if appropriate):

chakravarthik27 commented 7 months ago

This is an error by typing extension, caused by torch lib INFO: pip is looking at multiple versions of torch to determine which version is compatible with other requirements. This could take a while. Collecting torch Downloading https://download.pytorch.org/whl/cpu/torch-2.2.0%2Bcpu-cp39-cp39-linux_x86_64.whl (186.8 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 186.8/186.8 MB 14.5 MB/s eta 0:00:00 Collecting typing-extensions>=4.8.0 (from torch) Downloading