argilla-io / argilla

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
https://docs.argilla.io
Apache License 2.0
3.85k stars 360 forks source link

Relation Extraction Task #1839

Open dvsrepo opened 2 years ago

rdaniel commented 1 year ago

For tasks such as relation extraction or dependency parsing it would be useful for argilla to be able to show and edit links between token spans. See BRAT (http://brat.nlplab.org/) for a tool with that kind of functionality. Should be able to have properties and values associated with the links as well as the token spans. Functionality beyond BRAT would allow links, not just token spans, as the source and/or destination of a link.

davidberenstein1957 commented 1 year ago

Hey @rdaniel thanks for your input. I am sorry for the late response, I think I missed the notification in my e-mail.

I agree on the relationship extraction feature. It is often requested and as for now scheduled for 2023 Q3, I hope it will be early 2023 Q3.

And it is good to take relationship properties into account too, at my previous job we continuously struggled with this too. @dvsrepo @frascuchon, had you already considered this?

@rdaniel How would you like to be able to define these properties? Would something like a free field {key: value} work for you?

Have you been using Argilla for other use-cases too?

dvsrepo commented 1 year ago

Hi, @rdaniel thanks so much for your suggestion! As @davidberenstein1957 mentioned this is currently planned for Q3 next year but we work with a flexible roadmap and we'd be happy to start scoping this feature and maybe replan it for earlier next year.

We'd be happy to know more about your thoughts and related use cases for this feature.