Usability and acceptability of a cognitive training intervention (SMART) for people with multiple sclerosis (MS): A prefeasibility formative evaluation

NIHR Open Res. 2022 May 23:2:39. doi: 10.3310/nihropenres.13274.1. eCollection 2022.

Abstract

Background: Multiple sclerosis (MS) is a chronic autoimmune, inflammatory neurological disease of the central nervous system (CNS), increasing in incidence and prevalence across both developed and developing countries. Cognitive difficulties are common in MS sufferers with 70% experiencing difficulties in higher-level brain functioning such as planning, attention, problem solving, and memory. Computerised cognitive training programmes may hold promise as a treatment option for improving cognitive function in people with MS, subject to exploring and addressing potential barriers to usability and acceptability.

Methods: This study aimed to test the usability and acceptability of a computerised cognitive training intervention-Strengthening Mental Abilities Through Relational Training (SMART) -for people with MS, through a mostly qualitative prefeasibility design ( n= 12). There were two phases of testing: (1) initial usability testing via a think-aloud protocol ( n= 6) and (2) alpha-testing to assess experienced acceptability over a four-week period of engagement ( n= 6). Data from the two phases were subjected to Framework Analysis, wherein we deductively applied the Health IT Usability Evaluation Model and Theoretical Framework of Acceptability to assess usability and acceptability, respectively.

Results: Results show SMART to have satisfactory usability with participants reacting positively to the formatting, visuality, and process of the interface. Minor suggestions were made on how best to adapt SMART for people with MS, but the programme and facilitative support were generally perceived to be acceptable, with participants expressing positive feelings about taking part in the intervention, despite associated burdens.

Conclusions: This prefeasibility study provides preliminary evidence of the usability and acceptability of SMART as a computerised cognitive training programme for people with MS. We conclude that we can now move forward with a feasibility trial of SMART, with the intention of proceeding to a definitive trial with cost-effectiveness analysis.

Keywords: Multiple sclerosis; acceptability; cognitive rehabilitation; feasibility randomised controlled trial; relational training; usability.

Plain language summary

Aims: We are developing a new ‘brain training’ treatment to help people with multiple sclerosis (MS) who have problems with thinking skills ( e.g., problem-solving, attention, and memory). This study aimed to test whether the training (called ‘Strengthening Mental Abilities Through Relational Training’ [‘SMART’]) is suitable for people with MS. Specifically, we assessed whether SMART was easy to use and acceptable for use in their everyday lives.

Background: MS is a long-term condition that affects the nervous system, with the number of cases increasing in both developed and developing countries. MS affects an individual’s thinking skills, which can affect their ability to go about their everyday lives. Brain training has potential for improving thinking skills in people with MS, provided ease of use and factors impacting willingness to use the training are explored. Design and methods used: This study used a mix of methods, such as scores from objective tests and verbal feedback, to explore whether SMART is easy to use and acceptable for people with MS. The study had two phases: think-aloud interviews (participants provided feedback on whether the training interface and guidance were easy to use) and then the alpha-testing phase (participants tested the training over time, and then gave feedback on acceptability). Common and salient themes were identified in both phases.

Results: Participants found SMART to be suitably easy to use and acceptable for use by people with MS. Participants thought that the interface was visually appealing, and easy to operate and navigate. Participants made minor suggestions for improving the intervention, but feedback was generally positive, despite demands on time and energy.

Discussion: SMART appears to be suitable for people with MS. We conclude that we can go ahead with the next phase of testing SMART, as a possible treatment for improving thinking skills in people with MS.

Grants and funding

This project is funded by the National Institute for Health and Care Research (NIHR) under its Research for Patient Benefit (RfPB) Programme (Grant Reference Number NIHR201990). The views expressed are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care.