Evaluating Artificial Intelligence Systems to Guide Purchasing Decisions

Abstract

Many radiologists are considering investments in artificial intelligence (AI) to improve the quality of care for our patients. This article outlines considerations for the purchasing process beginning with performance evaluation. Practices should decide whether there is a need to independently verify performance or accept vendor-provided data. Successful implementations will consider who will receive AI results, how results will be presented, and the impact on efficiency. The article provides education on infrastructure considerations including the benefits and drawbacks of best-of-breed and platform approaches in addition to highly specialized server requirements like graphical processing unit availability. Finally, the article presents financial and quality and safety considerations, some of which are unique to AI. Examples include whether additional revenue could be obtained, as in the case of mammography, and whether an AI model unintentionally leads to reinforcing healthcare disparities.

Keywords: Artificial intelligence; health care disparities; infrastructure; machine learning; purchasing; quality and safety.