Community-based mosquito surveillance: an automatic mosquito-on-human-skin recognition system with a deep learning algorithm

Pest Manag Sci. 2022 Oct;78(10):4092-4104. doi: 10.1002/ps.7028. Epub 2022 Jun 17.

Abstract

Background: Public community engagement is crucial for mosquito surveillance programs. To support community participation, one of the approaches is assisting the public in recognizing the mosquitoes that carry pathogens. Therefore, this study aims to build an automatic recognition system to identify mosquitos at the public community level. We construct a customized image dataset consisting of three mosquito species in either damaged or un-damaged body conditions. To distinguish the mosquito in harsh conditions, we explore two state-of-the-art deep learning (DL) architectures: (i) a freezing convolutional base, with partial trainable weights, and (ii) training the entire model with most of the trainable weights. We project a weighted feature map on different layers of the model to visualize the morphological region used by the model in classification and compared it with the morphological key used by the expert.

Result: It was found that the model with architecture two and the Adam optimizer achieves at least 98% accuracy in mosquito and conditions identification and when implemented on an independent dataset, the Xception model generalizes the best result with an accuracy of 0.7775 and 0.795 precision. Moreover, most of the morphological regions used by the model are able to match those of the human expert.

Conclusion: We report a customized DL model for performing pest mosquito taxonomy identification, and through visualization, some regions using computers to discriminate mosquito species could be adopted later in systematic identification. © 2022 Society of Chemical Industry.

Keywords: deep convolutional neural network; expert system; pest mosquito; public engagement; vector control.

MeSH terms

  • Algorithms
  • Animals
  • Culicidae*
  • Deep Learning*
  • Humans
  • Image Processing, Computer-Assisted / methods
  • Neural Networks, Computer