Anthropogenic biases in chemical reaction data hinder exploratory inorganic synthesis

Abstract

Most chemical experiments are planned by human scientists and therefore are subject to a variety of human cognitive biases¹, heuristics² and social influences³. These anthropogenic chemical reaction data are widely used to train machine-learning models⁴ that are used to predict organic⁵ and inorganic^6,7 syntheses. However, it is known that societal biases are encoded in datasets and are perpetuated in machine-learning models⁸. Here we identify as-yet-unacknowledged anthropogenic biases in both the reagent choices and reaction conditions of chemical reaction datasets using a combination of data mining and experiments. We find that the amine choices in the reported crystal structures of hydrothermal synthesis of amine-templated metal oxides⁹ follow a power-law distribution in which 17% of amine reactants occur in 79% of reported compounds, consistent with distributions in social influence models^10-12. An analysis of unpublished historical laboratory notebook records shows similarly biased distributions of reaction condition choices. By performing 548 randomly generated experiments, we demonstrate that the popularity of reactants or the choices of reaction conditions are uncorrelated to the success of the reaction. We show that randomly generated experiments better illustrate the range of parameter choices that are compatible with crystal formation. Machine-learning models that we train on a smaller randomized reaction dataset outperform models trained on larger human-selected reaction datasets, demonstrating the importance of identifying and addressing anthropogenic biases in scientific data.