argilla-io / argilla

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
https://docs.argilla.io
Apache License 2.0
3.99k stars 377 forks source link

[BUG-UI/UX] Odd behaviour when deleting Spans when using multiple SpanQuestions #5233

Open Cy-Fi opened 4 months ago

Cy-Fi commented 4 months ago

Describe the bug When using FeedbackDataset with multiple SpanQuestions, if a span is deleted, all defined spans get removed.

To Reproduce Steps to reproduce the behavior:

  1. Create a feedback Dataset with a sample reccord: dataset = rg.FeedbackDataset( fields=[ rg.TextField( name="text_1", ), rg.TextField( name="text_2", ), ], questions=[ rg.SpanQuestion( name="span_1", labels={"EXPLANATION": "Explanation"}, field="text_1", required=False, allow_overlapping=False, ), rg.SpanQuestion( name="span_2", labels={"EXPLANATION": "Explanation"}, field="text_2", required=False, allow_overlapping=False, ) ], ) record = rg.FeedbackRecord( fields={ "text_1": "Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magna aliquyam erat, sed diam voluptua. At vero eos et accusam et justo duo dolores et ea rebum. Stet clita kasd gubergren, no sea takimata sanctus est Lorem ipsum dolor sit amet. Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magna aliquyam erat, sed diam voluptua. At vero eos et accusam et justo duo dolores et ea rebum. Stet clita kasd gubergren, no sea takimata sanctus est Lorem ipsum dolor sit amet.", "text_2": "labore et dolore magna aliquyam erat, sed diam voluptua. At vero eos et accusam et justo duo dolores et ea rebum. Stet clita kasd gubergren, no sea takimata sanctus est Lorem ipsum dolor sit amet." }, external_id=123 )

  2. Upload records to argilla

  3. Go to labeling tool

  4. label some spans in the two documents

  5. Click on the X to remove one span -->

Expected behavior Only the Span where the X was clicked is removed.

Screenshots image image

Environment (please complete the following information):

Additional context

nataliaElv commented 3 months ago

hi @Cy-Fi ! Have you tried upgrading Argilla to version 1.29.1 or even v2.0.0rc2? We are not able to reproduce it, so it might be an issue that has been already fixed in later versions. Try upgrading and let us know if you're still experiencing this issue.

github-actions[bot] commented 3 weeks ago

This issue is stale because it has been open for 90 days with no activity.