App Usage Factor: A Simple Metric to Compare the Population Impact of Mobile Medical Apps

J Med Internet Res. 2015 Aug 19;17(8):e200. doi: 10.2196/jmir.4284.

Abstract

Background: One factor when assessing the quality of mobile apps is quantifying the impact of a given app on a population. There is currently no metric which can be used to compare the population impact of a mobile app across different health care disciplines.

Objective: The objective of this study is to create a novel metric to characterize the impact of a mobile app on a population.

Methods: We developed the simple novel metric, app usage factor (AUF), defined as the logarithm of the product of the number of active users of a mobile app with the median number of daily uses of the app. The behavior of this metric was modeled using simulated modeling in Python, a general-purpose programming language. Three simulations were conducted to explore the temporal and numerical stability of our metric and a simulated app ecosystem model using a simulated dataset of 20,000 apps.

Results: Simulations confirmed the metric was stable between predicted usage limits and remained stable at extremes of these limits. Analysis of a simulated dataset of 20,000 apps calculated an average value for the app usage factor of 4.90 (SD 0.78). A temporal simulation showed that the metric remained stable over time and suitable limits for its use were identified.

Conclusions: A key component when assessing app risk and potential harm is understanding the potential population impact of each mobile app. Our metric has many potential uses for a wide range of stakeholders in the app ecosystem, including users, regulators, developers, and health care professionals. Furthermore, this metric forms part of the overall estimate of risk and potential for harm or benefit posed by a mobile medical app. We identify the merits and limitations of this metric, as well as potential avenues for future validation and research.

Keywords: mHealth; medical app; medical informatics apps; metric; mobile app; mobile health; mobile phone; patient safety; population impact; risk assessment.

Publication types

  • Comparative Study
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Cell Phone
  • Humans
  • Mobile Applications / statistics & numerical data*
  • Programming Languages
  • Risk Assessment
  • Telemedicine* / instrumentation
  • Telemedicine* / organization & administration