Show simple item record

dc.contributor.authorRebecca Bari Buchheit
dc.contributor.authorJames H. Garrett Jr.
dc.contributor.authorSue McNeil
dc.contributor.authorPing Chen
dc.date.accessioned2017-05-08T21:21:25Z
dc.date.available2017-05-08T21:21:25Z
dc.date.copyrightSeptember 2005
dc.date.issued2005
dc.identifier.other%28asce%291076-0342%282005%2911%3A3%28180%29.pdf
dc.identifier.urihttp://yetl.yabesh.ir/yetl/handle/yetl/48236
dc.description.abstractMonitoring data are collected to measure the condition, environment, usage, and performance of civil infrastructure. High quality monitoring data are necessary for decision-support systems, design analysis, and research. However, little work has been done in the area of generic, automated data quality assessment and cleansing procedures. We have developed an automated, two-level data quality assessment procedure to address this deficiency. In the first level of our procedure, several different data quality assessment methods are used in a voting scheme to identify concentrations of anomalies in aggregate data. In the second level, differences between anomalies and normal data at the individual data level are identified; combined with domain knowledge, these differences can be used to identify different types of errors, such as missing data and calibration errors. In our case studies, we have been able to effectively cleanse the data using the results from our data quality assessment procedure. We have also developed a test bench to explore the sensitivity of the data quality assessment algorithms used in our approach. The test bench introduces a known error into a clean, artificial data set and then evaluates how well each assessment method identifies the error. The test bench results show that our approach is able to effectively identify anomalies, even those with small magnitudes of error.
dc.publisherAmerican Society of Civil Engineers
dc.titleAutomated Procedure to Assess Civil Infrastructure Data Quality: Method and Validation
dc.typeJournal Paper
dc.journal.volume11
dc.journal.issue3
dc.journal.titleJournal of Infrastructure Systems
dc.identifier.doi10.1061/(ASCE)1076-0342(2005)11:3(180)
dc.treeJournal of Infrastructure Systems:;2005:;Volume ( 011 ):;issue: 003
dc.contenttypeFulltext


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record