twosixlabs / armory-library

Python library for Adversarial ML Evaluation
https://twosixlabs.github.io/armory-library/
MIT License
9 stars 3 forks source link

Text Model Support in Armory Library #180

Open deprit opened 1 month ago

deprit commented 1 month ago

We want to extend Armory Library to support the evaluation of text models, particularly LLMs. Supporting text evaluations will require the classes below.

LLM model sources:

Text evaluations and metrics: