Multimodal Fusion Network for Crack Segmentation with Modified U-Net and Transfer Learning–Based MobileNetV2

Abstract

This study introduces a state-of-the-art methodology for addressing crack segmentation challenges in structure health monitoring, a crucial concern in infrastructure maintenance. The main objective is to enhance real-time crack monitoring through a cutting-edge multimodal fusion approach that intricately combines a modified U-Net with transfer learning-based MobileNetV2. This integration strategically amalgamates spatial awareness and long-range dependency capture, resulting in an advanced model for crack segmentation. Thorough evaluations of a specialized crack detection data set underscore the efficacy of this integrated approach, positioning it as a reliable solution for real-time crack monitoring. Notably, the choice of MobileNetV2, recognized for its efficiency with the least parameters, contributes to the fusion’s effectiveness. This study reveals superior performance, particularly when MobileNetV2 is integrated with U-Net, demonstrating enhanced accuracy and Intersection over Union (IOU) scores.