Smartwatch User Interface Implementation Using CNN-Based Gesture Pattern Recognition

Sensors (Basel). 2018 Sep 7;18(9):2997. doi: 10.3390/s18092997.


In recent years, with an increase in the use of smartwatches among wearable devices, various applications for the device have been developed. However, the realization of a user interface is limited by the size and volume of the smartwatch. This study aims to propose a method to classify the user's gestures without the need of an additional input device to improve the user interface. The smartwatch is equipped with an accelerometer, which collects the data and learns and classifies the gesture pattern using a machine learning algorithm. By incorporating the convolution neural network (CNN) model, the proposed pattern recognition system has become more accurate than the existing model. The performance analysis results show that the proposed pattern recognition system can classify 10 gesture patterns at an accuracy rate of 97.3%.

Keywords: Internet of things; convolution neural network; gesture pattern recognition; machine learning; smartwatch; wearable device.

MeSH terms

  • Accelerometry
  • Gestures*
  • Humans
  • Machine Learning
  • Neural Networks, Computer*
  • Pattern Recognition, Automated*
  • User-Computer Interface*
  • Wearable Electronic Devices*