Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 7-Day Trial for You or Your Team.

Learn More →

A gesture- and head-based multimodal interaction platform for MR remote collaboration

A gesture- and head-based multimodal interaction platform for MR remote collaboration In this paper, we present a projector-based mixed reality (MR) remote collaborative system which enables remote users to collaboratively work on a physical task using gesture and head pointing (GHP). Using this platform, we studied the effects of GHP in a typical manufacturing use case. Our system supports natural and intuitive multimodal interaction based on GHP, and it can project the remote user’s GHP into the local environment to enhance remote collaboration. Our prototype system was compared with an augmented reality (AR) condition (ANNOTATION), which is the most popular method currently for AR/MR remote collaboration. We found a significant difference between the ANNOTATION and GHP conditions in terms of performance. The GHP system significantly improved the collaborative experience (e.g., awareness of the user’s attention), empathy (e.g., co-presence), and remote interaction. Moreover, we discuss the implications of this research and directions for future research. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png The International Journal of Advanced Manufacturing Technology Springer Journals

A gesture- and head-based multimodal interaction platform for MR remote collaboration

Download PDF
13 pages

Loading next page...
 
/lp/springer-journals/a-gesture-and-head-based-multimodal-interaction-platform-for-mr-remote-apMJxmDAHd

References (48)

Publisher
Springer Journals
Copyright
Copyright © 2019 by Springer-Verlag London Ltd., part of Springer Nature
Subject
Engineering; Industrial and Production Engineering; Media Management; Mechanical Engineering; Computer-Aided Engineering (CAD, CAE) and Design
ISSN
0268-3768
eISSN
1433-3015
DOI
10.1007/s00170-019-04434-2
Publisher site
See Article on Publisher Site

Abstract

In this paper, we present a projector-based mixed reality (MR) remote collaborative system which enables remote users to collaboratively work on a physical task using gesture and head pointing (GHP). Using this platform, we studied the effects of GHP in a typical manufacturing use case. Our system supports natural and intuitive multimodal interaction based on GHP, and it can project the remote user’s GHP into the local environment to enhance remote collaboration. Our prototype system was compared with an augmented reality (AR) condition (ANNOTATION), which is the most popular method currently for AR/MR remote collaboration. We found a significant difference between the ANNOTATION and GHP conditions in terms of performance. The GHP system significantly improved the collaborative experience (e.g., awareness of the user’s attention), empathy (e.g., co-presence), and remote interaction. Moreover, we discuss the implications of this research and directions for future research.

Journal

The International Journal of Advanced Manufacturing Technology – Springer Journals

Published: Nov 9, 2019

There are no references for this article.