An Augmented Reality Serious Game for Learning Intelligent Wheelchair Control: Comparing Configuration and Tracking Methods

Sensors (Basel). 2022 Oct 13;22(20):7788. doi: 10.3390/s22207788.

Abstract

This work proposes an augmented reality serious game (ARSG) for supporting individuals with motor disabilities while controlling robotic wheelchairs. A racing track was used as the game narrative; this included restriction areas, static and dynamic virtual objects, as well as obstacles and signs. To experience the game, a prior configuration of the environment, made through a smartphone or a computer, was required. Furthermore, a visualization tool was developed to exhibit user performance while using the ARSG. Two user studies were conducted with 10 and 20 participants, respectively, to compare (1) how different devices enable configuring the ARSG, and (2) different tracking capabilities, i.e., methods used to place virtual content on the real-world environment while the user interacts with the game and controls the wheelchair in the physical space: C1-motion tracking using cloud anchors; C2-offline motion tracking. Results suggest that configuring the environment with the computer is more efficient and accurate, in contrast to the smartphone, which is characterized as more engaging. In addition, condition C1 stood out as more accurate and robust, while condition C2 appeared to be easier to use.

Keywords: Industry 4.0; augmented reality; human-centered design; maintenance authoring tool; remote collaboration; user study; visual characteristics.

MeSH terms

  • Augmented Reality*
  • Humans
  • Learning
  • Smartphone
  • User-Computer Interface
  • Wheelchairs*