In particular, we propose visual cues presented through a head-mounted Augmented Reality display (Virtual Hand, Color Cue), and sound cues emitted from the cameras’ physical locations (Spatial Sound). We present CueCam, a multi-camera remote assistance system that supports mutual workspace awareness through a flexible ad-hoc camera calibration and various Augmented Reality cues that communicate the helper’s viewpoint and focus. However, it can be cumbersome to set up and calibrate multiple cameras, and it can be challenging for the local worker to identify the current viewpoint of the remote helper. This may be addressed by granting the helper view-independence, e.g., through a multi-camera system. For example, if the remote helper is limited to the single viewpoint provided by the worker’s hand-held or head-mounted camera, she lacks the ability to gain an overview of the workspace. Workspace awareness is critical for remote assistance with physical tasks, yet it remains difficult to facilitate.
This work will be useful for current and future researchers who are interested in collaborative AR/MR systems. The paper also provides an overall academic roadmap and useful insight into the state-of-the-art of AR/MR remote collaboration on physical tasks. Following this we report on issues for future works. We find that most papers (160 articles, 74.4%) are published in conferences, using co-located collaboration to emulate remote collaboration is adopted by more than half (126, 58.6%) of the reviewed papers, the shared non-verbal cues can be mainly classified into five types (Virtual Replicas or Physical Proxy(VRP), AR Annotations or a Cursor Pointer(ARACP), avatar, gesture, and gaze), the local/remote interface is mainly divided into four categories (Head-Mounted Displays(HMD), Spatial Augmented Reality(SAR), Windows-Icon-Menu-Pointer(WIMP) and Hand-Held Displays(HHD)). Next, we made an in-depth review of the papers from seven aspects: (1) collection and classification research, (2) using 3D scene reconstruction environments and live panorama, (3) periodicals and conducting research, (4) local and remote user interfaces, (5) features of user interfaces commonly used, (6) architecture and sharing non-verbal cues, (7) applications and toolkits. Then we elaborate on the review from typical architectures, applications (e.g., industry, telemedicine, architecture, teleducation and others), and empathic computing. We collected 215 papers, more than 80% of which were published between 20, and all relevant works are discussed at length. Therefore, this paper presents a comprehensive survey of research between 20 in this domain. However, to the best of our knowledge there has not been any comprehensive review of research in AR/MR remote collaboration on physical tasks. It has great potential in many fields, such as real-time remote medical consultation, education, training, maintenance, remote assistance in engineering, and other remote collaborative tasks. AR/MR-based remote collaboration on physical tasks has recently become more prominent in academic research and engineering applications.
This paper provides a review of research into using Augmented Reality (AR) and Mixed Reality(MR) for remote collaboration on physical tasks.
VIEWPOINT STARTUP PROBLEMS. REMOTEHELPER MAY NOT BE RUNNING PROFESSIONAL
Examples of AR/MR remote collaborative professional scenarios include remote technical support services, assembly and disassembly of complex parts, production and inspection processes, Co-design, through-life maintenance assistance, emergency repair guidance, telemedicine, tele-education, training 57]. However, compared with video-conferencing for physical tasks, AR/MR-based remote collaboration can support more natural and intuitive interaction, improve the performance time, provide more engaging user experience, and share some important non-verbal cues of collocated work (e.g., annotations, user's emotions, gaze and gestures ), which have been shown to increase empathy, trust, productivity and collaboration.
0 kommentar(er)
