search

patronus-ai / copyright-evals

https://www.patronus.ai/blog/introducing-copyright-catcher
Creative Commons Zero v1.0 Universal
18 stars 1 forks source link

Is OpenSouce Contribution to the evaluation dataset possible? #1

Open Kirushikesh opened 8 months ago

Kirushikesh commented 8 months ago

Hello Authors, Fascinated by the simplicity but an efficient solution. Currently if i am not wrong, the test data has 100 samples, which are used to test the LLM's. So is it possible for the opensource community to contribute more such prompts from the copyright content to the "test dataset". Allowing the opensource contribution adds diversity and quantity for a much generalised evaluation.

isunitha98selvan commented 8 months ago

Yes, feel free to submit a PR with new prompts. We will add it to the collection