Real time emotion aware applications: a case study employing emotion evocative pictures and neuro-physiological sensing enhanced by Graphic Processor Units

Comput Methods Programs Biomed. 2012 Jul;107(1):16-27. doi: 10.1016/j.cmpb.2012.03.008. Epub 2012 Apr 19.

Abstract

In this paper the feasibility of adopting Graphic Processor Units towards real-time emotion aware computing is investigated for boosting the time consuming computations employed in such applications. The proposed methodology was employed in analysis of encephalographic and electrodermal data gathered when participants passively viewed emotional evocative stimuli. The GPU effectiveness when processing electroencephalographic and electrodermal recordings is demonstrated by comparing the execution time of chaos/complexity analysis through nonlinear dynamics (multi-channel correlation dimension/D2) and signal processing algorithms (computation of skin conductance level/SCL) into various popular programming environments. Apart from the beneficial role of parallel programming, the adoption of special design techniques regarding memory management may further enhance the time minimization which approximates a factor of 30 in comparison with ANSI C language (single-core sequential execution). Therefore, the use of GPU parallel capabilities offers a reliable and robust solution for real-time sensing the user's affective state.

MeSH terms

  • Algorithms
  • Computer Graphics*
  • Computer Systems
  • Electroencephalography / psychology
  • Electroencephalography / statistics & numerical data
  • Emotions / physiology*
  • Galvanic Skin Response / physiology
  • Humans
  • Nervous System Physiological Phenomena
  • Nonlinear Dynamics
  • Signal Processing, Computer-Assisted
  • Software
  • Software Design
  • User-Computer Interface*