Mixed Reality And Human Robot Interaction PDF Download

This chapter leads the reader through the development of the AR-HRC system from concept and background through the design of the necessary set of interfaces required to enhance human-robot interaction. It thus began by introducing the need for human-robot collaborative teams in terms of current and emerging application spaces requiring collaboration to achieve or significantly improve outcomes. In particular, the area of space exploration will require human-robot interaction at levels well beyond current state of the art or understanding. Similar terrestrial applications are outlined that will be significantly enhanced, as well. However, it was also shown that little attention has been paid to research in this field. All of these issues provided the impetus for the creation of the Augmented Reality Human-Robot Collaboration (AR-HRC) system described here. A discussion of the related work in HRI has shown that an effective system should transfer the interaction mechanisms natural for humans to the precision required for machine information. Previous work in HRI has also shown that the autonomy level of an HRI system should be variable so that it can match the needs of a given situation. In this manner the system is able to capitalize on the problem solving skills of a human while also effectively balancing that with the speed and dexterity of a robot. Prior work in HRI also highlighted the importance of situational awareness. The lack of situational awareness has been shown to decrease performance and, in certain cases, can lead to catastrophic failures. Use of natural speech has also been shown to be effective in HRI. However, speech alone is not enough to complete the grounding process in the exchange between human and robot, leading to a reduced ability to communicate as a result. Therefore, a multi-modal interface is shown to provide a more effective approach. By combining speech with gesture, a more natural interface and the requisite grounding is achieved. The multi-modal medium used for the AR-HRC system presented here is Augmented Reality, which affords both speech and gestural communication channels. The literature review therefore includes an introduction to AR and the state of the art of AR in the context of using it in a multi-modal human-robot interaction system. AR has been shown to provide a shared work space that is conducive to collaboration and at the same time increases situational awareness, enhancing its potential in this situation. AR also supports a tangible user interface, essentially allowing a person to use a real world object to.