Segment Annotation Interface
See Segment Annotation Interface Controls and Instructions for details on how to use the interface.
Main design points
- Scan is shown rotating initially. This is to allow users to get a sense of the 3D nature of the scan and prompt them to use the camera controls.
- Ability to add free form labels. Free form so users are not restricted to a set of predefined labels. After collecting some initial data, we all labels appearing more than x times and offer it in the autosuggest (to prevent mistyping and help in canonicalization). For instancing, we allow multiple labels with same text.
- Painting interface (drag and paint). A natural metaphor that is intuitive and easy to understand.
- Limit to painting connected geometry with same label. Experiments that allowed MTurkers to override this option resulted in poor quality annotations where 1) some workers labeled entire scan with one label 2) some workers didn't label object instances.
Other features
- Automatic switching between painting and erasing mode with cursor indicating what mode the user is in (is this too confusing?)
- Hover with tooltip shows current annotation
- Can pick label via shortcut key, clicking on panel, or ctrl-click on already painted segments
Existing labels cannot be changed. This was found to not work very well due to issues with instancing.
- Existing labels can be changed (all labels displayed) via double click
- Labeled segments can be deleted
- Labeled segments can be merged
- Ctrl-shift-o to remove painting constraints
Interface with list of annotations
- For cleaned annotations: there is 'F' for fixup and 'V' button for verify
- Note: Currently fixup is for model (should be specified from certain annotation as well)
