Readability and quality of online patient materials in the websites of the Japanese Orthopaedic Association and related orthopaedic societies

Satoshi Yamaguchi; Kazunari Iwata; Kanako Nishizumi; Akane Ito; Seiji Ohtori

doi:10.1016/j.jos.2022.05.003

Readability and quality of online patient materials in the websites of the Japanese Orthopaedic Association and related orthopaedic societies

J Orthop Sci. 2023 Jul;28(4):901-906. doi: 10.1016/j.jos.2022.05.003. Epub 2022 Jun 9.

Authors

Satoshi Yamaguchi¹, Kazunari Iwata², Kanako Nishizumi³, Akane Ito⁴, Seiji Ohtori⁵

Affiliations

¹ Graduate School of Global and Transdisciplinary Studies, Chiba University, Chiba, Japan; Department of Orthopaedic Surgery, Graduate School of Medical and Pharmaceutical Sciences, Chiba University, Chiba, Japan. Electronic address: y-satoshi@mvb.biglobe.ne.jp.
² Department of Japanese Language and Literature, University of the Sacred Heart, Tokyo, Japan.
³ Graduate School of Global and Transdisciplinary Studies, Chiba University, Chiba, Japan.
⁴ College of Liberal Arts and Sciences, Chiba University, Chiba, Japan.
⁵ Department of Orthopaedic Surgery, Graduate School of Medical and Pharmaceutical Sciences, Chiba University, Chiba, Japan.

PMID: 35690541
DOI: 10.1016/j.jos.2022.05.003

Abstract

Background: The purpose of this study was to quantify the readability and quality of patient materials on the websites of the Japanese Orthopaedic Association and related orthopaedic societies.

Methods: We analyzed 143 online patient materials of seven societies, including the Japanese Orthopaedic Association and related six societies. The readability of the text in the material was quantified using two web-based programs ("Obi-3" and "Readability Research Lab") and lexical density. The materials with a difficulty level ≤ second grade of junior high school were classified as "average difficulty," and those ≤ sixth grade of elementary school were classified as "easy to read." The quality of the materials was quantified using the validated Clear Communication Index, DISCERN, and Journal of American Medical Association benchmark criteria scores. The proportion of materials classified as sufficient quality was determined. The measurement values were compared among societies using Kruskal-Wallis tests.

Results: The median difficulty level of the overall materials was the third grade of junior high school using the Obi-3 program. Only 44 (31%) were classified as average difficulty, and none were classified as easy to read. Based on lexical density, 31 (22%) materials were classified as average difficulty. The median Clear Communication Index score was 18 points out of 100. The median DISCERN and Journal of American Medical Association benchmark criteria scores were 27 (out of 75) and 0 (out of 4), respectively. Only one material met the criteria as having sufficient quality. There were significant differences among societies in the lexical density, Clear Communication Index, and DISCERN scores.

Conclusions: The patient materials on the Japanese Orthopaedic Association and related society websites were too difficult to understand. Furthermore, the quality of the materials was not sufficient. Improvement in readability and quality may be necessary to enhance patient-physician communication.

Keywords: Health literacy; Online patient material; Patient-physician communication; Readability.

MeSH terms

Comprehension
East Asian People
Health Literacy*
Humans
Internet
Orthopedics*
Societies, Medical
United States