How to load in tests and templates from tsv

marcotcr / checklist

Beyond Accuracy: Behavioral Testing of NLP models with CheckList

MIT License

2.01k stars 204 forks source link

How to load in tests and templates from tsv #112

Closed surajbhat-01 closed 2 years ago

surajbhat-01 commented 2 years ago

Hi,

I am currently trying to load in tests created by the Microsoft LoNLI repository. In this framework, they create tsv files that contain a label, and then the premise and hypothesis. How would I got about loading these in for the TestSuite and Editor through Checklist?

The repo I am referencing is linked here: https://github.com/microsoft/LoNLI

Thank you in advance, and I apologize if this seems like a trivial issue.

marcotcr commented 2 years ago

It doesn't seem like they created a TestSuite, it looks as if they just use CheckList to create a normal dataset. You should ask there though, I don't know :)