HumanSignal / label-studio

Label Studio is a multi-type data labeling and annotation tool with standardized output format
https://labelstud.io
Apache License 2.0
16.94k stars 2.1k forks source link

In the project overview, add a column type to see the number of labels in annotations and predictions #5881

Closed lastant closed 1 week ago

lastant commented 2 weeks ago

So far there are only columns 'Annotations' and 'Predictions', which actually mean 'revisions' it seems, but there's no way to see the actual number of labels, annotated and predicted. It would be useful if one expects a certain number of labels and could easily identify if labels are missing or too many.

makseq commented 1 week ago
  1. You can update your LS to the latest version from the github develop branch,
  2. run LS with experimental feature EXPERIMENTAL_FEATURES=1 label-studio (or add this variable to your environment variables),
  3. and then use the action "Cache Labels" in the Data manager: https://github.com/HumanSignal/label-studio/pull/5909

However, you have to run this action from time to time to invalidate the cache. Also note that opensource LS version doesn't have background workers and this operation might take long time if your dataset is huge.

Example: image You will see a new data column with labels and their counters.

lastant commented 1 week ago

Thank you! But is there a way to see the total number of labels?

makseq commented 1 week ago

@lastant you mean for all tasks? If yes, it's an LS Enterprise feature (see regions created): image

lastant commented 4 days ago

I mean showing the total number of labels in each task. Next to ID 2752 it would say 3. Next to 2753 - 1 ... Next to 427402 - 20

makseq commented 4 days ago

Cache Labels will show it.