Analyzing opioid-use disorder websites in the United States: An optimized website usability study

Shuhan He; Saishravan Shyamsundar; Paul Chong; Jasmine Kannikal; Joshua Calvano; Neha Balapal; Nick Kallenberg; Adarsh Balaji; Amala Ankem; Alister Martin

doi:10.1177/20552076221121529

Analyzing opioid-use disorder websites in the United States: An optimized website usability study

Digit Health. 2022 Oct 6:8:20552076221121529. doi: 10.1177/20552076221121529. eCollection 2022 Jan-Dec.

Authors

Shuhan He^{1

2

3

4}, Saishravan Shyamsundar⁵, Paul Chong⁶, Jasmine Kannikal⁷, Joshua Calvano⁸, Neha Balapal⁹, Nick Kallenberg¹⁰, Adarsh Balaji¹¹, Amala Ankem^{1

3}, Alister Martin^{1

3}

Affiliations

¹ Get Waivered, Massachusetts General Hospital, Boston, MA, USA.
² Lab of Computer Science, Massachusetts General Hospital, Boston, MA, USA.
³ Department of Emergency Medicine, Massachusetts General Hospital, Boston, MA, USA.
⁴ Center for Innovation in Digital Healthcare, Massachusetts General Hospital, Boston, MA, USA.
⁵ Geisinger Commonwealth School of Medicine, Scranton, PA USA.
⁶ Campbell University School of Osteopathic Medicine, Lillington, NC, USA.
⁷ University of Miami, Miller School of Medicine, Coral Gables, FL, USA.
⁸ University of New Mexico Hospital, Albuquerque, NM, USA.
⁹ City University of New York School of Medicine, New York, NY, USA.
¹⁰ Queen Mary University - Bethnal Green, London, UK.
¹¹ American University of the Caribbean School of Medicine, Coral Gables, FL, USA.

Abstract

Background: As the United States continues to tackle the opioid epidemic, it is imperative for digital healthcare organizations to provide Internet users with accurate and accessible online resources so that they can make informed decisions with regards to their health.

Objective: The primary objectives were to adapt and modify a previously established usability methodology from literature, apply this modified methodology in order to perform usability analysis of opioid-use-disorder (OUD)-related websites, and make important recommendations that OUD-related digital health organizations may utilize to improve their online presence.

Methods: A list of 208 websites (later refined) was generated for usability testing using a modified Google Search methodology. Four keywords were chosen and used in the search: "DEA-X Waiver Training", "opioid-use-disorder (OUD) Initiatives", "Buprenorphine Assisted Treatment", and "Opioid-Use Disorder Websites". Usability analysis was performed concurrently with optimization of the methodology. OUD websites were analyzed and scored on several usability categories established by previous literature.

Results: "DEA-X Waiver Training" yielded websites that scored the highest average in "Accessibility" (0.84), while "Opioid-Use Disorder Websites" yielded websites that scored the highest average in "Content Quality" (0.67). "Buprenorphine Assisted Treatment" yielded websites that scored the highest average across "Marketing" (0.52), "Technology" (0.89), "General Usability" (0.69), and "Overall Usability" (0.68). "Technology" and "Marketing" were the highest and lowest scoring usability categories, respectively. T-test analysis revealed that each usability, except "Marketing" had a pair of one or more keywords that were significantly different with a p-value that was equal to or less than 0.05.

Conclusions: Based on the study findings, we recommend that digital organizations in the OUD space should improve their "General Usability" score by making their websites easier to find online. Doing so, may allow users, especially individuals in the OUD space, to discover accurate information that they are seeking. Based on the study findings, we also made important recommendations that OUD-related digital organizations may utilize in order to improve website usability as well as overall reach.

Keywords: Opioid epidemic; opioid-use disorder; usability testing.