Augmented Reality Remote Collaboration with Dense Reconstruction

This paper describes an Augmented Reality remote collaboration system leveraging high-fidelity; dense scene reconstruction for intuitive and precise remote guidance. A local worker in need of help can use our system to automatically generate a 3D mesh of the scene that is streamed to a remote expert. Thanks to the reconstruction the remote expert can navigate and explore the scene independently of the local worker in full six degrees of freedom. World-stabilized text- and image-annotations can be placed in the scene and strokes drawn on surfaces are placed intelligently in the world. In addition; the reconstruction allows the remote expert to segment objects from the scene and create simple animations with these 3D models to convey precise instructions.