The use of crowdsourcing for dietary self-monitoring: crowdsourced ratings of food pictures are comparable to ratings by trained observers

Abstract

Objective: Crowdsourcing dietary ratings for food photographs, which uses the input of several users to provide feedback, has potential to assist with dietary self-monitoring.

Materials and methods: This study assessed how closely crowdsourced ratings of foods and beverages contained in 450 pictures from the Eatery mobile app as rated by peer users (fellow Eatery app users) (n = 5006 peers, mean 18.4 peer ratings/photo) using a simple 'healthiness' scale were related to the ratings of the same pictures by trained observers (raters). In addition, the foods and beverages present in each picture were categorized and the impact on the peer rating scale by food/beverage category was examined. Raters were trained to provide a 'healthiness' score using criteria from the 2010 US Dietary Guidelines.

Results: The average of all three raters' scores was highly correlated with the peer healthiness score for all photos (r = 0.88, p<0.001). Using a multivariate linear model (R(2) = 0.73) to examine the association of peer healthiness scores with foods and beverages present in photos, peer ratings were in the hypothesized direction for both foods/beverages to increase and ones to limit. Photos with fruit, vegetables, whole grains, and legumes, nuts, and seeds (borderline at p = 0.06) were all associated with higher peer healthiness scores, and processed foods (borderline at p = 0.06), food from fast food restaurants, refined grains, red meat, cheese, savory snacks, sweets/desserts, and sugar-sweetened beverages were associated with lower peer healthiness scores.

Conclusions: The findings suggest that crowdsourcing holds potential to provide basic feedback on overall diet quality to users utilizing a low burden approach.

Keywords: crowdsourcing; diet; mobile health; self-monitoring; technology.