Consumer health information and question answering: helping consumers find answers to their health-related information needs

J Am Med Inform Assoc. 2020 Feb 1;27(2):194-201. doi: 10.1093/jamia/ocz152.

Abstract

Objective: Consumers increasingly turn to the internet in search of health-related information; and they want their questions answered with short and precise passages, rather than needing to analyze lists of relevant documents returned by search engines and reading each document to find an answer. We aim to answer consumer health questions with information from reliable sources.

Materials and methods: We combine knowledge-based, traditional machine and deep learning approaches to understand consumers' questions and select the best answers from consumer-oriented sources. We evaluate the end-to-end system and its components on simple questions generated in a pilot development of MedlinePlus Alexa skill, as well as the short and long real-life questions submitted to the National Library of Medicine by consumers.

Results: Our system achieves 78.7% mean average precision and 87.9% mean reciprocal rank on simple Alexa questions, and 44.5% mean average precision and 51.6% mean reciprocal rank on real-life questions submitted by National Library of Medicine consumers.

Discussion: The ensemble of deep learning, domain knowledge, and traditional approaches recognizes question type and focus well in the simple questions, but it leaves room for improvement on the real-life consumers' questions. Information retrieval approaches alone are sufficient for finding answers to simple Alexa questions. Answering real-life questions, however, benefits from a combination of information retrieval and inference approaches.

Conclusion: A pilot practical implementation of research needed to help consumers find reliable answers to their health-related questions demonstrates that for most questions the reliable answers exist and can be found automatically with acceptable accuracy.

Keywords: artificial intelligence; consumer health questions; deep learning; natural language processing; question answering.

Publication types

  • Research Support, N.I.H., Intramural

MeSH terms

  • Consumer Health Information*
  • Datasets as Topic
  • Deep Learning*
  • Humans
  • Information Storage and Retrieval / methods*
  • Machine Learning
  • MedlinePlus*
  • Natural Language Processing
  • Pilot Projects
  • Search Engine
  • Unified Medical Language System