User Interface for 3D Marking Using Augmented Reality Headset

Building on our successful work on Mixed Reality Simulation and Augmented Reality (AR) simulation to enable informed design decisions, we present this novel AR project that can accomplish 3D marking task where the 3D position of a real world object is indicated by placing an virtual marker in the AR scene. To enhance and improve AR user interface for mobile AR users, we explore three techniques, called Geometric, Perceptual and MultiSample, that work even when geometry of real-world environment is unknown. 

Geometric:

The user is asked to look directly at the marking target and indicate current head orientation. Then after moving with sufficient distance, the user needs to gaze at the same target and report the new gaze direction. Then the system can obtain target's 3D position via trangulation. The accuracy for estimation depends heavily on the distance between two oberservation locations.

Perceptual:

The user is asked to look directly at the marking target and indicate current head orientation. Then a virtual marker will appear in the AR scene immeidiately and the user needs to move the marker to desired distance along the direction. The accuracy is related to user's distance perception and can be improved by providing depth cues like relative size, linear perspective atmospheric attenuation.

MultiSample:

This technique is a variation of Geometric technique using progressive refinement. As its name indicates,, instead of only gathering two samples, it allows the user to send multiple direction samples. Since one single sample might not be accurate due to factors like user head trimmering, a refinement can be achived by using the average of multiple data samples.