Deep Learning-Based Positioning of Visually Impaired People in Indoor Environments

Sensors (Basel). 2020 Oct 31;20(21):6238. doi: 10.3390/s20216238.

Abstract

Wayfinding and navigation can present substantial challenges to visually impaired (VI) people. Some of the significant aspects of these challenges arise from the difficulty of knowing the location of a moving person with enough accuracy. Positioning and localization in indoor environments require unique solutions. Furthermore, positioning is one of the critical aspects of any navigation system that can assist a VI person with their independent movement. The other essential features of a typical indoor navigation system include pathfinding, obstacle avoidance, and capabilities for user interaction. This work focuses on the positioning of a VI person with enough precision for their use in indoor navigation. We aim to achieve this by utilizing only the capabilities of a typical smartphone. More specifically, our proposed approach is based on the use of the accelerometer, gyroscope, and magnetometer of a smartphone. We consider the indoor environment to be divided into microcells, with the vertex of each microcell being assigned two-dimensional local coordinates. A regression-based analysis is used to train a multilayer perceptron neural network to map the inertial sensor measurements to the coordinates of the vertex of the microcell corresponding to the position of the smartphone. In order to test our proposed solution, we used IPIN2016, a publicly-available multivariate dataset that divides the indoor environment into cells tagged with the inertial sensor data of a smartphone, in order to generate the training and validating sets. Our experiments show that our proposed approach can achieve a remarkable prediction accuracy of more than 94%, with a 0.65 m positioning error.

Keywords: deep learning; indoor; inertial sensor; multi-layered perceptron; positioning; smartphone; visually impaired.

MeSH terms

  • Accelerometry
  • Algorithms
  • Deep Learning*
  • Humans
  • Magnetometry
  • Neural Networks, Computer*
  • Smartphone*
  • Spatial Navigation*
  • Visually Impaired Persons*