argilla-io / argilla

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
https://docs.argilla.io
Apache License 2.0
4k stars 378 forks source link

[FEATURE] Add the possibility of multi-checkboxes with editable content from the user interface on the right panel #5663

Open louisbrulenaudet opened 3 weeks ago

louisbrulenaudet commented 3 weeks ago

For a specific application of producing RAG system evaluation datasets, I'd like to be able to register document IDs via the right-hand panel. My problem is that the number of documents is unequal between Records and, to remedy this, I would need to be able to dynamically add elements in the form of an avoidable checkbox with the possibility of continuing to enter other checkbox elements that follow it for the same question.

Today, it seems to me that we can proceed in a quite efficient way, which would be to use a TextQuestion with a separator between the strings representing the IDs of the different documents, and then treat everything post-annotation as a list of strings. However, the UX could be greatly improved. Here's an example of what I want to explain, inspired by the Tally form production site:

okg