bbernhard
commented
4 years ago Many thanks for all this awesome suggestions - very much appreciated! At the moment I am still pretty busy with the first prototype of the "joint connections mode", but once that is done I'll definitely come back to that. Thanks a lot - great to see all those awesome suggestions! :)
not really an urgent request.. ideas for how the unified mode could be presented slightly differently.. tags = a seperate area to add the "scene labels"/"theme labels" - eg "street","farm","retail","military",season,time of day, etc. Currently the dataset includes these in the label list , but there's an ambiguity about them being potential tasks or not. Perhaps certain words from the existing label list could always be displayed here (also all "un-annotatable" labels). This would map to the typical search-tags idea found in many website.
Then the label-list,properties area, and new joints would be selectable via a tab-view, including a new "Label Palette" area. The work area would be expanded
Label Palette - is like the 'add-labels view' most-common label list, but refined by itself being grouped. There'd be a drop-box to select between preset "label palettes".
Examples would be:
They would not be mutually exclusive - the same label can appear in several
also using labels from one palette would not preclude adding individual custom labels, or other palettes
using a label palette would not imply the presence of all labels, just the individual ones that you annotate with
I'd imagine about 5-15 of these groups as a starting point
Ideally you'd cover the whole label list this way ; the broad groups like 'animal','vehicle' would let you easily find anything
it's a way to organise labels system-wide by theme, not per image
This would save re-typing or re-selecting common groupings of labels
Thanks to the existing seperators we can already paste a group of labels into the label-list entry box (this works fine. you can keep the "label palettes" in a text editor on the desktop), but I dont think casual users will figure this out.
It might also be a good way to suggest the annotations - a bit like the intent of the original Task system, but in a different way - less rigid, more like a broad hint. (e.g. what if tags make it select a default label palette: the act of "tagging" the image with a broad label suggests the subsequent detailed annotations for it..)
Labels here would be available for selection , but not added to the scene until you actually draw something. At the same time, selecting a label here would be just like selecting it in the existing label list, i.e. it would show all the current polygons of that label. You could still place a tick to indicate which labels here are used in the current scene.
Existing functionality: you'd still want to be able to enter custom labels, into the "annotations" list.
Properties view I think this wants to be more like an alternative filter of the polygon list, rather than a division of the label: e.g. you should be able to see all polygons of "metal", rather than than selecting "fork", then show "metal forks" (e.g. in a table scene, selecting "metal" will show the metal fork, metal spoon, metal knife). What I have in mind is a tool to toggle the selected property with all the polygons available (click the polygon to enable/disable the property. draw all the polygons on one color, and the current selected property in another). It would be great if you could draw 'unlabelled' polys with the current property aswell, but that might be a hard retrofit. ultimately, I like setting properties and labels at the same time through "/" combination best, but the properties idea is good to add information and I can see it being useful for "intermediate users" to add information to existing scenes.
"current label entry box" i've still drawn the existing [...][+] entry box in the label list but imagine if there was a seperate string entry box available in all the views mirroring the current label selection - almost like the current 'command' ("Annotate all: car") but an interactive selector . Analogy: Current colour in a paint program. Sometimes a paint program will have a current color, but also 3 different ways to select colors.. a dedicated color wheel, "swatches" or preset palettes (hence the "label palette" here), and an "eyedropper tool" to pick it from the scene.