Detecting Semantic Anomalies in Truck Weigh-in-Motion Traffic Data Using Data Mining

Abstract

Monitoring data from event-based monitoring systems are becoming more and more prevalent in civil engineering. An example is truck weigh-in-motion (WIM) data. These data are used in the transportation domain for various analyses, such as analyzing the effects of commercial truck traffic on pavement materials and designs. It is important that such analyses use good quality data or at least account appropriately for any deficiencies in the quality of data they are using. Low quality data may exist due to problems in the sensing hardware, in its calibration, or in the software processing the raw sensor data. The vast quantities of data collected make it infeasible for a human to examine all the data. The writers propose a data mining approach for automatically detecting semantic anomalies i.e., unexpected behavior in monitoring data. The writers’ method provides automated assistance to domain experts in setting up constraints for data behavior. The effectiveness of this method is shown by reporting its successful application to data from an actual WIM system, the experimental data the Minnesota department of transportation collected by its Minnesota road research project (Mn/ROAD) facilities. The constraints the expert set up by applying this method were useful for automatic anomaly detection over the Mn/ROAD data, i.e., they detected anomalies the expert cared about, e.g., unlikely vehicles and erroneously classified vehicles, and the misclassification rate was reasonable for a human to handle (usually less than 3%). Moreover, the expert gained insights about system behavior, such as realizing that a system-wide change had occurred. The constraints detected, for example, periods in which the WIM system reported that roughly 20% of the vehicles classified as three-axle single-unit trucks had only one axle.