Practical Deployment of BIM-Interoperable Voice-Based Intelligent Virtual Agent Support Construction Worker Productivity

Abstract

The architecture, engineering, and construction (AEC) industry in the US faces increasing labor shortages while accumulating downward productivity trends. Previous research efforts have shown that lack of timely access to information is one of the main factors hindering construction workers’ productivity, and prompt information extraction (IE) from BIM sources can help address this issue. This study develops a BIM-web interoperable system, featuring a voice-based intelligent virtual agent (VIVA), to provide workers with information on-demand when conducting their activities on the jobsite. VIVA integrates construction digital sources with web platforms to enable real-time data communication between the users, workers in this case, and BIM platforms. The voice interaction feature of VIVA provides an intuitive and safe tool that can easily be used by workers with varying ranges of experience, with minimal need for training. The responsiveness and accuracy of VIVA is evaluated through two proof-of-concept case studies. Results indicate that the BIM-VIVA link and underlying natural language understanding (NLU) algorithms in the Google Actions platform accurately understand user queries, with a performance of 97.50% correct responses. As a result, VIVA achieves superior performance compared with previous research works based on NLU algorithms with text-based queries. The developments made in this research not only contribute to improving the safety and productivity of construction workers but also can open the door for easier onboarding of less-experienced workers, thus addressing the industry’s severe skilled labor shortage issue. This study introduces an innovative web-based system featuring VIVA to address the pressing labor shortage and diminishing productivity in the AEC industry. VIVA seamlessly integrates construction digital sources with web platforms, enabling real-time communication with construction workers and facilitating their on-demand information retrieval. The intuitive voice interaction feature of VIVA offers a safe and easily navigable tool that demands minimal training for workers with diverse backgrounds and experience levels. This feature also makes VIVA a practical tool for hands-free communication and information retrieval on jobsites, which minimizes the imposed distraction inherent in technological solutions. Construction workers can use voice commands to access project plans, schedules, and safety protocols, allowing them to retrieve critical information without having to stop work or use their hands. This intuitive interface reduces the need for complex user interfaces or manual input, making it easier for workers to interact with technology while focusing on their tasks. Hence, VIVA promises to improve productivity and safety of diverse group of workers without causing distraction or safety issues itself, which is a common concern when implementing technology to assist workers in hazardous and ever-changing construction jobsites. Beyond enhancing safety and productivity, widespread use of VIVA can help address the AEC sector’s severe skilled labor shortage by providing an accessible means to onboard less-experienced workers. As such, VIVA provides opportunities to augment efficiency for seasonal/nonnative workers, thus facilitating the integration of a broader workforce and addressing the industry’s pressing labor challenges.