some way to browse labels/tasks .. summary,

[dobkeratops]

as the label list gets longer (which is essential) , it's getting harder to find tasks by label i.e. figure out which label to do next (and the random mode is still difficult because it will show so many awkward tasks),

Some ideas that could help:-

(i) beefing up the stats page to show a labels/annotations count - and being able to click into annotation mode. The point being you could see which labels have fewer annotations, guiding you toward useful tasks - aswell as seeing the total work accumulated across the whole set (very motivational)

eg

    label    annotations/labels
    car      1029       / 1500
    road     800        / 800
    person   300        / 400
    ..
    hat      50         / 65
    TV       3          / 10      

clicking on a line here could launch browse/annotate with the label in question.

I'm not sure what the best default sort would be.. either

• annotations (seeing total work.. so head to the bottom to improve the dataset's breadth),
• labels plus annotations (even adding the label is a form of accumulated work)
• or remaining tasks (labels minus annotations)?

(ii) adding something similar to the browse/annotate view itself:i.e. if there's no expression, perhaps show one image from each label .. then clicking it puts that label into the expression (I guess you could show the same information 'label-name, annotations' in the tooltip; it would be even better if the view could show a caption directly. (caption= car (1029/1500) )

this kind of visual overview of the whole dataset would be really nice generally, more inviting to start with something like that.

(iii) Probably much harder to retrofit: being able to choose new labels whilst you annotate. I think this is more useful with the obscure labels .. there's fewer instances, and you find them sporadically. Annotating and labelling in one step would save you from having to find things twice. as a middle ground you could still just draw a box for later polygon enhancement; this would also make validation easier. ("does this image contain a red shoe somewhere in the crowd..?" vs "is this annotation a red shoe?")

[bbernhard]

Great ideas, thanks a lot for the suggestions!

Annotating and labelling in one step would save you from having to find things twice.

Haven't thought about that before, but you are totally right - that defintely makes sense and would make it way easier in some cases. I think that would be great addition :)

suggestion (i) resp. (ii) reminded me of something, that I've started on my dev branch a while ago, but never completed. It's a "Statistics" Button in the annotation view. After clicking the button, a dialog opens which shows the completness of each label (ordered by least completed first). When you click on a label, the label is used as search expression.

The "Statistics" Button

After click on the "Statistics" Button, this dialog opens:

Actually, I wanted to deploy this changes to production in today's maintenance window, but unfortunately I discovered a regression shortly before. So it will probably go live in a few days.

It's probably not as nice as your suggestions, but as it was already almost done, I thought that it might make sense to push this one to production first - we can always rework it :)

[bbernhard]

ok, I've pushed it to production. Unfortunately, I have messed up the sorting a bit...so the progress bars are not ordered at the moment (I'll fix that in the next days).

The annotation view has also changed a bit (the annotation toolbox + the "annotate all xxx" are now always visible) and the done + skip buttons changed a bit. There are still a lot of improvements missing from your (@dobkeratops) list, but I wanted to get some feedback first, whether it's going in the right direction or if the old UI was better.

[bbernhard]

(if we want to keep the current UI, I guess it would make sense to add a bit more space between the "done buttons" and the footer. And maybe also remove some space between the header and the image - there is quite a lot of white space)

Any feedback is highly appreciated. I used it a bit myself and I have to admit that it feels a bit odd that the header is now sticky. But maybe it's it takes a bit of time to get used to the new UI :D

[dobkeratops]

thats an interesting tweak (sticky header bar).. it does solve the problem . I like the new 'done or skip' too

[dobkeratops]

ok, Ive seen the 'annotation statistics' .. this does indeed solve the issue in a manner similar to suggestion (i). You can use it to find a label in need of attention, and it's great to see the overview.

One thing I might suggest to tweak that view is for the chart to be a (logarithmic?) number of total annotations, rather than a percentage, then that would visually make the least annotated objects stand out (remember it can also guide people to find new images) .. I would also prefer the animation to be disabled (it's a bit distracting) but it's thats's not a serious problem.. maybe a colour there can just be tweaked then you still have some visual interest (I do understand the motivation for a screen that comes to life with motion)