search

HumanSignal / label-studio

Label Studio is a multi-type data labeling and annotation tool with standardized output format
https://labelstud.io
Apache License 2.0
19.26k stars 2.39k forks source link

Task Filters passing wrong results to Label All Tasks button if using select all checkbox #3546

Open Timbot-42 opened 1 year ago

Timbot-42 commented 1 year ago

If I add some filters to my list of NER tasks the table results correctly show the filtered results. If I check the checkbox at the top of the first column to select all tasks, and then hit the Label All Tasks button, I am getting some other tasks showing up as well. Then when I go back to the task list those other ones are now in the table.

I am passing several columns in addition to my Sentence/Comment column, so I can filter comments by question, project etc.

Expected behavior Correctly filtered tasks should be passed correctly to Label All Tasks button

**Workaround If I check all the tasks in the results table manually instead of using the select all box, then click Label X Tasks it will cycle through the correctly filtered tasks.

Environment (please complete the following information):

makseq commented 1 year ago

I tried to reproduce it, but no success. Could you please record a video?

hctchristine commented 1 year ago

I am experiencing a similar issue and cannot reliably label the tasks selected by the filter. For example, when I filter for country2 contains "India" and Annotations = 0 and select "Label All Tasks", the first response that I am presented with has country2 as Kenya, not India. image image

When I select all tasks or use "Label Tasks As Displayed", I am presented with tasks that have already been labeled, despite having chosen "Annotations = 0". image

My current workaround is to click on each task to label one by one, but that is not very efficient.

jfarr03 commented 1 year ago

I am also experiencing this issue, where filtering the tasks and either

does not respect the filtering displayed in the table. Any help in fixing this issue would be very much appreciated!

averdones commented 11 months ago

I think I am encountering the same issue: https://github.com/HumanSignal/label-studio/discussions/5096