TY - JOUR
T1 - Use of Parallel ResNet for High-Performance Pavement Crack Detection and Measurement
AU - Fan, Zhun
AU - Lin, Huibiao
AU - Li, Chong
AU - Su, Jian
AU - Bruno, Salvatore
AU - Loprencipe, Giuseppe
N1 - Publisher Copyright:
© 2022 by the authors. Licensee MDPI, Basel, Switzerland.
PY - 2022/2/1
Y1 - 2022/2/1
N2 - In the process of road pavement health and safety assessment, crack detection plays a pivotal role in a preventive maintenance strategy. Recently, Convolutional Neural Networks (CNNs) have been applied to automatically identify the cracks on concrete pavements. The effectiveness of a CNN-based road crack detection and measurement method depends on several factors, including the image segmentation of cracks with complex topology, the inference of noises with similar texture to the distress, and the sensitivity to thin cracks. The presence of shadows, strong light reflections, and road markings can also severely affect the accuracy in detection and measurement. In this study, a review of the state-of-the-art CNN methods for crack identification is presented, paying attention to existing limitations. Then, a novel deep residual convolutional neural network (Parallel ResNet) is proposed with the aim of creating a high-performance pavement crack detection and measurement system. The challenge and special feature of Parallel ResNet is to remove the noise inference, identifying even thin and complex cracks correctly. The performance of Parallel ResNet has been investigated on two publicly available datasets (CrackTree200 and CFD), comparing it with that of competing methods suggested in the literature. Parallel ResNet reached the maximum scores in Precision (94.27%), Recall (92.52%), and F1 (93.08%) using the CrackTree200 dataset. Similarly, for the CFD dataset the novel method achieved high values in Precision (96.21%), Recall (95.12%), and F1 (95.63%). Based on the crack detection and image recognition results, mathematical morphology was then used to further minimize noise and accurately segment the road diseases, obtaining the outer contours of the connected domain in crack images. Therefore, crack skeletons have been extracted to measure the distress length, width, and area on images of rigid pavements. The experimental results show that Parallel ResNet can effectively minimize noise to obtain the geometry of cracks. The results of crack characteristic measurements are accurate and Parallel ResNet can be assumed as a reliable method in pavement crack image analysis, in order to plan the best road maintenance strategy.
AB - In the process of road pavement health and safety assessment, crack detection plays a pivotal role in a preventive maintenance strategy. Recently, Convolutional Neural Networks (CNNs) have been applied to automatically identify the cracks on concrete pavements. The effectiveness of a CNN-based road crack detection and measurement method depends on several factors, including the image segmentation of cracks with complex topology, the inference of noises with similar texture to the distress, and the sensitivity to thin cracks. The presence of shadows, strong light reflections, and road markings can also severely affect the accuracy in detection and measurement. In this study, a review of the state-of-the-art CNN methods for crack identification is presented, paying attention to existing limitations. Then, a novel deep residual convolutional neural network (Parallel ResNet) is proposed with the aim of creating a high-performance pavement crack detection and measurement system. The challenge and special feature of Parallel ResNet is to remove the noise inference, identifying even thin and complex cracks correctly. The performance of Parallel ResNet has been investigated on two publicly available datasets (CrackTree200 and CFD), comparing it with that of competing methods suggested in the literature. Parallel ResNet reached the maximum scores in Precision (94.27%), Recall (92.52%), and F1 (93.08%) using the CrackTree200 dataset. Similarly, for the CFD dataset the novel method achieved high values in Precision (96.21%), Recall (95.12%), and F1 (95.63%). Based on the crack detection and image recognition results, mathematical morphology was then used to further minimize noise and accurately segment the road diseases, obtaining the outer contours of the connected domain in crack images. Therefore, crack skeletons have been extracted to measure the distress length, width, and area on images of rigid pavements. The experimental results show that Parallel ResNet can effectively minimize noise to obtain the geometry of cracks. The results of crack characteristic measurements are accurate and Parallel ResNet can be assumed as a reliable method in pavement crack image analysis, in order to plan the best road maintenance strategy.
KW - Automated distress evaluation systems
KW - Convolutional neural networks
KW - Crack detection
KW - Crack measurement
KW - Image processing
KW - Pavement monitoring
KW - Residual network
UR - http://www.scopus.com/inward/record.url?scp=85124976711&partnerID=8YFLogxK
U2 - 10.3390/su14031825
DO - 10.3390/su14031825
M3 - Article
AN - SCOPUS:85124976711
SN - 2071-1050
VL - 14
JO - Sustainability (Switzerland)
JF - Sustainability (Switzerland)
IS - 3
M1 - 1825
ER -