Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Apr:184:105355.
doi: 10.1016/j.ijmedinf.2024.105355. Epub 2024 Feb 12.

Comparison of evaluation methods for improving the usability of a Spanish mHealth tool

Alexandria L Hahn  1 , Claudia L Michaels  2 , Gabriella Khawly  2 , Tyler K Nichols  3 , Pamela Baez  4 , Sergio Ozoria Ramirez  3 , Janeth Juarez Padilla  5 , Samantha Stonbraker  6 , Susan Olender  7 , Rebecca Schnall  2
Affiliations

Comparison of evaluation methods for improving the usability of a Spanish mHealth tool

Alexandria L Hahn et al. Int J Med Inform. 2024 Apr.

Abstract

Objective: Mobile health (mHealth) technology is now widely used across health conditions and populations. The rigorous development of these tools has yielded improved health outcomes, yet the ideal approach for developing mHealth tools continues to evolve, indicating the need for rigorous usability evaluation methods. This study compares two usability evaluation methods - cognitive interviews and usability assessments employing a think-aloud approach - for adapting an evidence-based mHealth tool from English into Spanish.

Methods: We conducted cognitive interviews and usability assessments using a think-aloud protocol to evaluate the usability of an HIV mHealth application among 40 Spanish-speaking adults with HIV in New York City, NY, and La Romana, Dominican Republic. The Health IT Usability Evaluation Model (Health-ITUEM) was used to guide the analysis of qualitative data collected from each method.

Results: Participants (N = 40) averaged 43 years old (SD = 12.26; range 20-79), identified primarily Hispanic/Latino (92.5 %), and resided in La Romana (50 %) or New York City (50 %). Both usability evaluation methods yielded similar findings, highlighting learnability and information needs as crucial components of participant feedback for the mHealth application. Cognitive interviews captured participants' perspectives on the app's interface and design. On the other hand, results from usability assessments offered insights into participants' competency while interacting with the mHealth tool.

Conclusion: Findings from this study highlight the contributions and limitations of including cognitive interviews and task-based usability assessments using a think-aloud approach in mHealth usability testing. Future research should employ a multi-method approach, incorporating complementary usability evaluation methods and engaging participants in multiple assessments. Using complementary usability evaluation methods may provide a more comprehensive understanding of the usability and participant experience aspects of a mHealth tool compared to using a single usability evaluation method.

Keywords: Cognitive Interviews; Think aloud; Usability; Usability evaluation methods; mHealth.

PubMed Disclaimer

Conflict of interest statement

Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Similar articles

See all similar articles

Cited by

References

    1. Akter S, & Ray P (2010). mHealth - an Ultimate Platform to Serve the Unserved. Yearbook of Medical Informatics, 94–100. - PubMed
    1. Cole-Lewis H, & Kershaw T (2010). Text messaging as a tool for behavior change in disease prevention and management. Epidemiologic Reviews, 32(1), 56–69. 10.1093/epirev/mxq004 - DOI - PMC - PubMed
    1. Rathbone AL, & Prescott J (2017). The Use of Mobile Apps and SMS Messaging as Physical and Mental Health Interventions: Systematic Review. Journal of Medical Internet Research, 19(8), e295. 10.2196/jmir.7740 - DOI - PMC - PubMed
    1. Schnall R, Rojas M, Travers J, Brown W 3rd, & Bakken S (2014). Use of Design Science for Informing the Development of a Mobile App for Persons Living with HIV. AMIA Annual Symposium Proceedings, 2014, 1037–1045. - PMC - PubMed
    1. Ostergren JE, Rosser BR, & Horvath KJ (2011). Reasons for non-use of condoms among men who have sex with men: a comparison of receptive and insertive role in sex and online and offline meeting venue. Culture, Health & Sexuality, 13(2), 123–140. 10.1080/13691058.2010.520168 - DOI - PMC - PubMed

LinkOut - more resources