Classifying the difficulty levels of working memory tasks by using pupillary response

PeerJ. 2022 Mar 29:10:e12864. doi: 10.7717/peerj.12864. eCollection 2022.

Abstract

Knowing the difficulty of a given task is crucial for improving the learning outcomes. This paper studies the difficulty level classification of memorization tasks from pupillary response data. Developing a difficulty level classifier from pupil size features is challenging because of the inter-subject variability of pupil responses. Eye-tracking data used in this study was collected while students solved different memorization tasks divided as low-, medium-, and high-level. Statistical analysis shows that values of pupillometric features (as peak dilation, pupil diameter change, and suchlike) differ significantly for different difficulty levels. We used a wrapper method to select the pupillometric features that work the best for the most common classifiers; Support Vector Machine (SVM), Decision Tree (DT), Linear Discriminant Analysis (LDA), and Random Forest (RF). Despite the statistical difference, experiments showed that a random forest classifier trained with five features obtained the best F1-score (82%). This result is essential because it describes a method to evaluate the cognitive load of a subject performing a task using only pupil size features.

Keywords: Classifiers; Cognitive load; Pupil size; Working memory.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Humans
  • Learning
  • Memory, Short-Term* / physiology
  • Pupil* / physiology

Grants and funding

This work was supported by the FORDECYT-296737 project “Consorcio en inteligencia artificial” 287. We received financial support from the Council of Science Technology and Innovation of Zacatecas state (COZCyT). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.