A Method of Mining Truck Loading Volume Detection Based on Deep Learning and Image Recognition

Sensors (Basel). 2021 Jan 18;21(2):635. doi: 10.3390/s21020635.

Abstract

Detection of the loading volume of mining trucks is an important task in open pit mining. Aiming at the addressing the current problems of low accuracy and high cost of the detection of the loading volume of mining trucks, this paper proposes a mining truck loading volume detection model based on deep learning and image recognition. The training and test data of the model consists of 6000 sets of images taken in a laboratory environment. After image preprocessing, the VGG16 network model is used to pre classify the ore images. The classification results are displayed and the possibility of each category is determined. Then, the loading volume of mining trucks is calculated by using the classification results and the least squares algorithm. By using the labeled image data of five kinds of mining truck loading volume, the arbitrary loading volume detection of mining trucks is realized, which effectively solves the problem of a lack of labeled data types caused by the difficulty in obtaining mine data. Root mean square error (RMSE) and mean absolute error (MAE) are used to evaluate the fitting effect of the model. The experimental results show that the model has high prediction accuracy. The average absolute error is 17.85 cm3. In addition, this paper uses 400 real mining truck images of open-pit mines to verify the model and the average absolute error is 2.53 m3. The experimental results show that the model has good generality and can be applied well to the actual production of open-pit mines.

Keywords: VGG16; image recognition; least square algorithm; loading volume; open pit mine.