| Ray-based interaction |
Place a point; Select a UI element |
Point the ray and press the trigger, main controller |
Points can be placed while the cursor is visible on a visualization.
Selectable (2D) UI elements: buttons and sliders in each menu, scrolling, and labels. |
| Constrained interaction |
Move an object |
On or in the object, press and hold the grip button on any of the controllers |
Depending on the object, common constraints include:
- gravity constraint (default),
- movement along a given axis,
- movement at regular intervals (image slices).
Translation of volume renderings is done through a separate ''handle'', which itself has a (smaller) ''handle''.
|
| Continuous movement |
Move viewing position in the environment |
Joystick button |
Movement in the horizontal plane (XZ): joystick on the main controller.
Movement in the vertical plane and rotation (Y): joystick on the 2nd controller. |
| Button press |
Open/close Settings |
Menu button, main controller |
The settings menu follows your gaze. |
| Button press |
Open/close context menu |
Menu button, 2nd controller |
The context menu is itself grabbable. |
| Button press |
Pause application |
System button, main controller |
Useful to load data without removing the headset.
After pausing, in SteamVR, Quest Link, etc. switch to Desktop viewing. |
| Rotation of voxels |
Rotate volumetric data |
By grabbing rotation axes on the ''handle'' |
Each rotation axis has a different colour.
For repeatability, rotating is constrained to multiples of 5° (see label on the ''handle'').
|
| Selection of user data |
Select a point |
While holding the trigger (2nd controller), draw a shape to visually mark objects inside of it. |
The mechanism is an extension of the well-known window selection to 3D. To clear or change selection, draw again. |
| Selection via touch |
Select a region |
Touch a region's envelope to select it. |
Region selection is used to confirm on which region the command, previously activated from the context menu, should be run.
|
| Selection of labels |
Select visualization data |
Via ray-based interaction with the label (yellow) |
Label selection is used to confirm for which model (visualization data) should the export/import command be run.
|
| Two-hand scaling |
Scale an object |
In an object, press and hold both grip buttons while stretching/squashing. |
Linear mapping to the distance between the two controllers. Scaling is uniform. |
| Swipe in the air |
Undo an operation |
While holding the grip button (2nd controller), swipe/flick outwards to the left. |
Suitable for quickly undoing small, recent changes. |