Vision-Based Detection of Unsafe Worker Guardrail Climbing Based on Posture and Instance Segmentation Data Fusion

Abstract

Currently, the incidence of accidents involving falls from height at construction sites caused by workers climbing guardrails is still high. Traditional unsafe behavior management mainly relies on a safety patrol of construction-site supervisors, which consumes considerable laborpower and time. There is still a critical need for an automated safety management method to identify unsafe guardrail climbing behavior. This study proposes a worker behavior identification method based on visual data fusion of a worker’s surrounding environment and posture data. Videos of seven participants’ guardrail climbing behavior through multiangle and multidistance cameras were analyzed to verify this method. By analyzing the environment and posture of the participants, three methods based on environment, posture, and fusion data were used to detect the stage of guardrail climbing action of the workers and compare them with the ground truth labeled by safety experts. The precision and recall of worker guardrail climbing behavior based on the fusion method were 82% and 83% respectively, which is better performance than that obtained using a single method. The data fusion–based method avoids the misjudgment generated by a single detection method and can identify the guardrail climbing behavior more accurately. Guardrail climbing is a typical unsafe behavior that exposes workers to a high risk of falling from height. However, there is a lack of research on the interaction between workers and guardrail systems in the construction industry. This study provides a nonintrusive method for automating detection and management of guardrail climbing behavior on construction site. Using existing surveillance cameras, this method can be deployed at low cost with slight interference with workers. Based on the detection, appropriate interventions are expected to effectively reduce workers’ unsafe behaviors during construction and improve safety on site. The detection of guardrail climbing, which is one of the variety of unsafe behaviors associated with falls from height, can enrich the intelligent construction safety management system effectively. Moreover, this study also provides reference and quantitative indicators (e.g., a guardrail climbing unsafe behavior database) for risk assessment and early warning of workers who are exposed to risk of fall from height.