Automation in Construction 116 (2020) 103254

Contents lists available at ScienceDirect

Automation in Construction
journal homepage: www.elsevier.com/locate/autcon

XR
From BIM to extended reality in AEC industry T
a,⁎ b c
Sepehr Alizadehsalehi , Ahmad Hadavi , Joseph Chuenhuei Huang
a
Project Management Program, Department of Civil and Environmental Engineering, Northwestern University, Evanston, IL, USA
b
Project Management Program, Department of Civil and Environmental Engineering, Northwestern University, Evanston, IL, USA
c
Project Management Program, Department of Civil and Environmental Engineering, Northwestern University, Evanston, IL, USA

A R T I CLE IN F O ABST RACT

Keywords: In the Architecture, Engineering, and Construction (AEC) industry, Extended Reality (XR) technologies that
Extended reality (XR) simulate a construction project in a multidimensional digital model and present multiple aspects of a project can
Building information modeling (BIM) be a tremendous help in all stages of a project. This study aims to identify the outsourcing patterns for such
AEC industry technologies among construction project stakeholders. Currently, there is limited literature about XR technol-
ogies, and because of it, the sections containing the results of this study are as follows: (1) a concise review of the
most recent VR, AR, and MR technologies in the design and construction industry; (2) an introduction to the
most commonly used wearable XRs on the market in terms of features, ease of use, and their specifications; (3) a
summary of the different methods and software used for converting the BIM model to VR, AR, and MR; and (4)
finally, a case study included the integrated definition function (IDEF0) model that details how to convert the
BIM model of the NASA-Mars habitat project to a VR and MR model that uses Oculus Rift, HTC Vive, Samsung
HMD, and Microsoft HoloLens headsets. Overall, this study provides a comprehensive review regarding using XR
to solve a variety of construction project management issues effectively and efficiently. More importantly, this
study provides a roadmap for future efforts involving the implementation of XR technologies in the AEC in-
dustry.

1. Introduction construction projects and to produce data-rich models has helped the
AEC industry shift from vision to realization [2]. BIM has the capability
AEC is a highly competitive industry, and AEC firms that embrace of integration with data of various capturing technologies like Laser
the latest technologies will position themselves ahead of the competi- Scan, image-based/photogrammetry, Global Positioning System (GPS),
tion due to their willingness to take advantage of and adapt to these Barcoding, Ultra Wide Band (UWB), Radio Frequency Identification
technologies. The construction industry is one of the fastest-growing (RFID), and Quick Response (QR) coding to create different compre-
industries in the United States of America, Europe, and the world. The hensive data/information about a project [3]. By utilizing recent
AEC sector is still in the infancy of its much-anticipated move from modeling software, architects and engineers can create n-D models that
tradition to automation. Therefore, it is necessary and urgent to in- are not only parametric and object-oriented but also embedded with
troduce and develop techniques, tools, and technologies into the AEC detailed information for current and future construction projects. BIM
industry—technologies that will facilitate intelligent and real-time in- provides a central hub of data that designers, architects, service en-
teractions among people, information/data, and representations across gineers, mechanical, electrical and plumbing (MEP) contractors, op-
actual and virtual worlds. This way, the AEC industry has the potential erators, and facility management (FM) companies can access and exe-
to truly revolutionize how to design, build, and operate in the con- cute this hub of data for new buildings of any type and size besides of
struction industry. existing projects [4]. BIM as a process is targeted at the procedure of
Building information modeling (BIM) as a digital information daily production; at using the most effective technology available that
management system is one of the most significant and promising has been proven to increase production; and at the improvement of
changes in the AEC industry. This is because BIM represents a paradigm return on investment (ROI) through refined and standardized processes
shift via a methodology to manage design data in a digital format for [5]. The process is key to the success of a BIM project. However, the
use throughout a project's life cycle [1]. The adoption of BIM to manage challenge is related to interoperability and data translation from the

Corresponding author.
⁎

E-mail addresses: [email protected] (S. Alizadehsalehi), [email protected] (A. Hadavi),

[email protected] (J.C. Huang).

https://doi.org/10.1016/j.autcon.2020.103254
Received 7 December 2019; Received in revised form 11 March 2020; Accepted 30 April 2020
Available online 14 May 2020
0926-5805/ © 2020 Elsevier B.V. All rights reserved.
S. Alizadehsalehi, et al. Automation in Construction 116 (2020) 103254

design (architect and engineer) phase to the construction (contractor/ the 3D/BIM model to VR, AR, and MR will be discussed as well. In
builder) phase to the operation and maintenance (owner) phase. addition, in Section 3, this paper will discuss the ongoing development
However, despite BIM's success so far, still a high percentage of projects of workflows in converting the BIM model to XR, a process referred to
do not achieve the full benefits of adopting and implementing BIM as “BIM-to-XR.” Finally in Section 4, this paper will cover the workflow
because of some limitations that slow the BIM implementation process. and steps of converting the 3D BIM model of the NASA-Mars habitat
Sun et al. [6] identified and classified these limitation factors into five project to a VR model in Oculus Rift, HTC Vive, Samsung HMD and an
categories: technology, cost, management, personnel, and legal. On the MR model in Microsoft HoloLens which have been done by the authors
technology side, regardless of all technology improvements, BIM usage of this article as part of the Master of Project Management (MPM)
has not yet reached its full potential. This is because of most common program at Northwestern University. In Sections 5 and 6, this paper
problem with BIM: the information is not presented in a way that concludes with the lessons learned by applying XR to project manage-
people can understand entirely on a real scale. While BIM enables us to ment tasks. Those sections indicate the benefits, current barriers, and
walk into a project conveniently, the weakness lies in not being able to future directions of BIM-to-XR in different construction management
walk through the project on a practical scale. It would be ideal if the areas.
real scale can be immersed into the model. In that way, the users can
“feel” the materials, lighting, furniture, and other small details from the 2. Background
model as well as see them from multiple perspectives.
Extended Reality (XR) provides a solution to this problem. XR is a This section outlines key related works in the six main areas re-
collective term for immersive technologies—including virtual reality levant to this paper: (1) BIM in the AEC industry; (2) XR in the AEC
(VR), augmented reality (AR), and mixed reality (MR) technolo- industry; (3) VR in the AEC industry; (4) AR in the AEC industry; (5)
gies—that refers to the spectrum of experiences that blur the line be- MR in the AEC industry; and (6) Summary of XR in Design and
tween the real world and virtual environments. XR technologies im- Construction Industry.
merse the user through visuals, audio, and potentially olfactory and
haptic touch cues. The three major types of XR are VR, AR, and MR.
2.1. Building information modeling (BIM)
Although currently the strongest demand for these immersive tech-
nologies comes from the “creative” industry (such as video entertain-
BIM is a set of interacting processes, roles, policies, and technolo-
ment and gaming), XR technologies have enormous potential to im-
gies, creating virtual information-based models to manage data in the
prove AEC efficiency and productivity. The potential needs to be
digital format used within the AEC industry. BIM is a created multi-
continuously uncovered and encouraged. Although the implementation
dimensional (n-D) knowledge resource/model aimed at containing in-
of XR in AEC is quite limited, the potential for this technology to re-
formation about a facility that forms a reliable basis for decisions
volutionize the sector is already widely accepted.
during the facility's life cycle. BIM allows the exchange of information
BIM has revolutionized the AEC industry, and people can leverage
efficiently in real-time to enable users to realize the value of digital
the full potential of emerging technology by integrating BIM and XR.
information management in practice [7]. The goal is to design, con-
VR technologies that incorporate BIM are used mainly to support de-
struct, and maintain a project throughout its life cycle. The effort in-
sign, decision-making, education and training related to design and
volved could include new and existing projects such as residential
construction, and construction safety management. AR is expected to
construction, commercial construction, industrial construction, heavy
have the most significant impact on the AEC industry, especially on
construction, infrastructure construction, and heritage construction [8].
construction operations, in four ways: by reducing rework; by im-
BIM, which is aimed at new projects, is generated in a process over
proving safety improvement; by lowering labor cost; and by making
several lifecycle phases: inception, design, construction, maintenance,
sure that deadlines are met. MR has been used to aid design; to support
operation, and demolition.
construction education; to support construction assembly procedures;
In existing buildings, depending on the availability of an existing
to enhance the collaboration and decision-making process; and to
BIM model, the BIM model can be either an updated model or a new
strengthen sustainability analysis. BIM and XR are not only rapidly
model. To create an accurate and fast as-built BIM model of existing
growing technologies that have gained significant investment and ac-
projects, recent technological advances such as laser scanning, photo-
ceptance as business tools in the AEC industry, but are also attracting
grammetry, and drones are helpful. Recently, more sophisticated
numerous research studies at universities and other research institu-
modeling, in the form of, for example, Historic Building Information
tions.
Modeling (HBIM), has emerged. This type of modeling develops full
The primary objective of this article is to fill a gap in literature by
BIM models from remotely sensed data. HBIM consists of a novel library
providing a comprehensive overview of currently researched and
of reusable parametric objects that are based on historic architectural
available in the market to adopt BIM and XR technologies in the AEC
data and a system for mapping these data to 2D/3D models [9,10].
industry. As shown in Fig. 1, this paper starts out with a literature re-
Bianchini and Nicastro [11] discussed the potential outcomes, ad-
view of the previous work on the concept of XR (VR, AR, and MR) and
vantages, and critical aspects related to HBIM systems, and tested their
BIM in the AEC industry in Section 2. This paper will elaborate on all
findings in a comprehensive case study to clearly highlight the inner
headsets that are used in the market, along with their specifications. A
features of the HBIM model. As an example of this type of project,
variety of different methods and software that are used for converting
NotreDame Cathedral is one of the most iconic symbols of architectural

Fig. 1. Research framework.

2
S. Alizadehsalehi, et al. Automation in Construction 116 (2020) 103254

beauty and history in Paris. It took almost 200 years to be built but was Virtuality. In the film industry, the integration of VR or AR technologies
partially destroyed in just minutes by a fire in April 2019. The 3D point with other methods such as green screen background can change or
cloud data captured by laser scanner yields precise captured images of improve the nature of these methods. In VR environments, which shut
the building in digital format to create its HBIM model, which a few out the real world, everything is virtual content, including the user
years ago helped to provide the foundation of the entire rebuilding and (avatar). In AR, digital content is on the top of the user's real world. So,
restoration project. when using a green screen background, the real world is the physical
Moreover, BIM can be used effectively as a powerful management people involved in the process. Despite the unclear and multifunctional
tool/process in different stages of new and existing projects in corre- definition of XR, there are more and more people who prefer to use
lation to some of the Project Management focus areas, such as site lo- “XR” term to describe the incorporating the VR/AR/MR experience into
cation analyzing [12]; designing a 3D model [13]; analyzing various real projects in the AEC industry to flexibly adapt and cross-reference
design options [14]; clash detection [15]; energy simulation [16]; data.
schedule time planning; cost estimating; coordination of a model
among different project stakeholders [17]; quality inspection [18]; vi- 2.3. Virtual reality (VR)
sualization [19]; as-built modeling [20]; quantity takeoff [14]; facility
management [21]; and generation of procurement plans [22]. BIM has Virtual Reality (VR) refers to computer technologies that use soft-
the capability to create, update, maintain, manage, store, and share ware to generate realistic images, sounds, and other sensations that
information in multiple dimensions. A key advantage of it is in the ef- represent an immersive environment and simulate a user's physical
ficiencies achieved at every stage of the project lifecycle, typically re- presence in this environment. The concept of VR came into prominence
sulting in cost reduction. Developing BIM to make use of capital ex- in the 1990s, when several industries were influenced by games and the
penditure (CAPEX) and operational expenditure (OPEX) will help all first immersive human-computer interaction (HCI) mockup, “Man-
project stakeholders to use various cost estimating techniques to predict Machine Graphical Communication System.” After 2005, a second wave
the project's cost at the early AEC stages in order to enhance optimize of VR emerged and was more successfully employed in different fields,
design. BIM can reduce quantity take-offs affecting CAPEX; however, it including engineering, medicine, mental health, design, architecture,
can moreover increase precise lifecycle cost estimates affecting OPEX. and construction, education and training, the arts, entertainment,
Therefore, these combined decrease the total expenditure (TOTEX) business, communication, marketing, military and travel. Now, the
[23,24]. development of devices, components, software products, and user in-
BIM helps all the involved stakeholders understand, participate, terfaces is advancing quickly throughout the world, and many leading
communicate, and collaborate with each other to obtain a high-quality players in manufacturing and e-commerce are adopting these technol-
outcome in all stages of a project. Communication among project sta- ogies. Evidence suggests that VR technologies are effective in con-
keholders and collaboration during the design and construction process struction safety training [29], project schedule control [30], and site
of a project have been altered with BIM and common data environment layout optimization of construction projects [31]. VR technologies can
(CDE) in the AEC industry in cases where BIM is used to facilitate the also provide environments for better collaboration among stakeholders
sharing of information, knowledge, and technology among multiple [32]; enable a better understanding of complex designs [33]; identify
stakeholders [25]. The CDE is given a single source of information for design issues [34]; depict building geometry so that users can make
the project that used to collect, manage, evaluate, and share informa- sense of a project and reach a better design decision [35]; and aid
tion, non-graphical data and all created data in a BIM environment collaborative decision-making [36].
among all project team members [26]. A CDE devoted to digital in-
formation management could be a project server, an extranet, or a 2.4. Augmented reality (AR)
cloud-based system. The centralization of data storage within CDE helps
in facilitating collaboration, avoiding data redundancy and errors, and Augmented Reality (AR) is an overlay of computer-generated con-
ensuring the availability of up-to-date data at any time [27]. In recent tent on the real world that can superficially interact with the environ-
years, many software products with powerful BIM functionalities have ment in real time [29]. With AR, there is no occlusion that appears
been introduced by many different vendors to create, implement, and between computer-generated content and real-world content. In most
manage, and store nD-models. The created models have produced cases, the computer-generated content is only viewable from smart-
parametric, object-oriented nD-models that are embedded with detailed phone or tablet devices. The phone-based and tablet-based AR (i.e.,
information that describes any project in any stage of the project life- iPad) devices provide a very limited immersive viewing experience.
cycle. Also, the limited wearable AR devices like Meta 2 (with 90-degree field
of view) and Google Glass are designed for the information objects and/
2.2. Extended reality (XR) or digital objects being superimposed on top of the real-world context.
There are four types of AR: 1. maker-based AR (i.e., scanning a QR
The terms Extended Reality, “X-Reality” or XR can be first traced code); 2. location-based AR (i.e., integrated with GPS for mapping di-
back to the 1960s. In the 1990s, XR was used for computerized eye- rections); 3. projection-based AR (i.e., projecting artificial light onto
glass-based mediated reality. In the 2000s, Coleman, Paradisio, and real-world surfaces); and 4. superimposition-based AR (i.e., an AR type
Landay introduced the term “Cross Reality” [28]. “XR” and “X-Reality” such as the IKEA app that places virtual furniture in a real environ-
have also been trademarked by Sony Corporation in the usage fields of ment).
smartphones, computer graphics, software applications, and display Researchers have proposed several ways to use AR for Architecture,
technologies. Generally speaking, XR refers to all real-and-virtual Engineering and Construction, and Facility Management (AEC/FM)
combined environments and human-machine interactions generated by projects that can yield many advantages for enhancing and improving
computer technology and wearables. XR includes VR, AR, and MR. In representation techniques on a job site. Rankohi and Waugh [37]
other words, XR can be defined as an umbrella that brings AR, VR, and conducted a statistical review of recent AR research studies in AEC. This
MR together under one term, leading to less public confusion than review showed which field workers and project managers (PM) have a
previously. Essentially, MR is another version of AR, and the former high interest in using non-immersive and desktop standalone AR tech-
allows users to interact with virtual information displayed in the real nologies during the construction phase mainly to monitor progress and
world. This interaction makes the user experience more realistic. Fig. 2 detect defective work. Shin and Dunston [38] presented a compre-
compares these terms. XR provides a wide variety and vast number of hensive map to indicate AR application areas in industrial construction.
levels in the Virtuality of partially sensor inputs to Immersive They revealed that eight work tasks—layout, excavation, positioning,

3
S. Alizadehsalehi, et al. Automation in Construction 116 (2020) 103254

Fig. 2. Comparison of VR, AR, and MR wearable technologies.

inspection, coordination, supervision, commenting, and strategi- Currently, the most well-known MR headsets on the market are Mi-
zing—may potentially benefit from AR support. In another study, crosoft HoloLens, Magic Leap One, and DAQRI Smart Glasses. Aliza-
Behzadan [39] did a general overview of the use of AR technology in dehsalehi et al. [43] show how applications of MR with other tech-
construction management applications. Also, Rankohi and Waugh [37] nologies and techniques of AEC can increase the productivity and
classified AR applications used in the AEC industry in seven categories: performance of construction processes at all stages. For MR utilization
visualization or simulation; communication or collaboration; informa- and adoption, the use of rapidly changing technology, software, and
tion modeling; information access or evaluation; progress monitoring; devices makes AEC industry forecasts notoriously difficult. Cheng et al.
education or training; and safety or inspection. [44] summarized the challenges of MR as: accuracy of spatial regis-
tration, user interface (UI), data storage and transfer, and multiuser
2.5. Mixed reality (MR) collaboration. On the other hand, continuous improvement in MR tools
and software rapidly leads to measurable increases in performance and
Mixed Reality (MR) is a “reality spectrum” that combines the best makes MR more effective every year. The XR hardware landscape is
aspects of VR and AR. MR ranges between pure “reality,” as seen by a changing rapidly. Future hardware advances should improve visual
user without computer intervention, and pure “virtual reality,” which realism and user comfort. Moreover, because of the rapid growth of MR
involves a computer-generated environment in which the user has no adoption and implementation, MR technology has gained acceptance as
interaction with the physical world [40]. While the VR experience al- a valuable tool for improving a project's design and construction pro-
lows the users to become immersed in a digital environment detached cesses.
from the real world, AR enables the digital content to be placed “on
top” of the real world, and MR facilitates the digital content to be in- 2.6. Summary of XR in the design and construction industry
teractive with the real world [41,42]. MR deals with obstacles and
boundaries and provides another level of interactivity. The key term for Table 1 shows a summary of previous research that used VR, AR,
MR is “flexibility.” This is what makes MR more marketable and less and MR technologies, with or without BIM, for different applications in
geeky than its cousins (see Fig. 3). various stages of design and construction from 2010 through 2020.
However, the product category is somewhat loosely defined because There are a number of XR-wearables on the market now. Table 2
of the few devices available on the market. For example, the Windows summarizes the most common wearable headsets including VR, AR, and
Mixed Reality headsets (made by multiple vendors like Samsung, HP, MR types. For help in making comparisons, the table lists features ac-
Acer, Dell, and Lenovo) are just VR headsets that do not allow the user cording to type and manufacturer. Since there are so many different
to see through Head Mounted Devices (HMDs) to be able to observe an goggles, it is important to see what the most common area of use is.
overlapping view of the digital content interacting with the physical
environment. The potential applications of MR in the AEC industry are 3. BIM-to-XR
numerous, especially applications involving the virtual/physical con-
text overlapping/interacting feature on a construction site [42]. Building Information Modeling (BIM) is not only about designing

Fig. 3. Reality-virtuality continuum [40].

4
S. Alizadehsalehi, et al. Automation in Construction 116 (2020) 103254

Table 1
Extended reality technologies in design and construction stages, 2010–2020.
n References VR AR MR Integrated Applications Stage Evaluation methodologies
With BIM
D C R F S CS I

1 [7] √ * Monitoring of construction projects √ * *

2 [44] √ * Applications of MR in the AECO industry √ √ *
3 [43] √ * Integration of BIM, lean construction, and MR √ √ * *
4 [32] √ * Design and construction education √ √ *
5 [29] √ √ * Construction safety √ √ *
6 [36] √ * Collaborative decision making √ √ *
7 [45] √ Construction safety √ *
8 [46] √ * Construction safety training √ *
9 [42] √ * Prefabrication √ √ *
10 [47] √ Construction safety-communication √ *
11 [48] √ * Site survey √ *
12 [49] √ * Evaluate the effectiveness of BIM and AR √ √ *
13 [50] √ √ Operation, maintenance, productivity, safety √ * *
14 [51] √ √ * Review and comparison of VR and AR √ *
15 [52] √ * Collaborative decision making √ √ *
16 [53] √ * Construction safety √ √ *
17 [54] √ * Construction safety √ √ *
18 [55] √ Improving the understanding of architectural 3D models √ *
19 [56] √ * Benefits and challenges for VR in construction industry √ * *
20 [57] √ * Construction safety training/jobsite management. √ √ *
21 [58] √ * Building energy performance gap √ √ *
22 [59] √ Construction safety √ √ *
23 [60] √ Environmental representation √ * *
24 [61] √ √ √ * Architecture and environmental planning education √ √ *
25 [62] √ Show the value of using virtual environments √ √ * *
26 [63] √ Construction engineering education √ * *
27 [64] √ * Real-time communication and problem solving √ *
28 [65] √ Construction safety training √ √ *
29 [66] √ Remote design review/problem-solving √ *
30 [67] √ Credibility and applicability of virtual reality √ √ *

Note: n = Reference number; D = Design, C = Construction; R = Review; F = Framework; S = Survey; CS = Case Study; I = Interview.

virtually with 3D elements, but also about the embedded information security issues with sharing files. To be more specific, it is advisable to
and data integration throughout the project life cycle. With BIM to use a game engine software product such as Unity or Unreal to reassign
Extended Reality (XR) workflow, can visualize the proposed design in materials, lighting, reactors, and data parameters after a design has
an interactive way with human scale and immersive experience. Users been created using BIM platforms. After the XR-ready model has been
can interact with the 3D information model on top of the physical space created and uploaded to the cloud, the design can then change, and the
by either superimposing the different design options within the existing XR model can become outdated. Also, because of the use of cloud-based
job site condition or reading additional information that does not exist applications via wireless VR or MR headsets, the file size limitation and
in the real world (for example, scanning the QR code for facility daylight brightness (for example, for Microsoft HoloLens) usually
management information). XR provides a new way of generating design hinder the application of game engine technology during the design and
creativity beyond the 2D drafting board and computer screen. The voice construction process. Fortunately, there are more software vendors in-
command and gesture-recognition functions allow more human-ma- tegrating with XR. Bentley Synchro has a plugin for Revit that displays
chine interaction. Integrating holographic technology like the Microsoft BIM elements in 4D simulation with lean construction schedule input
HoloLens with BIM workflows adds unprecedented value from design to like P6. This plugin gives users the ability to review construction se-
construction to the operation and maintenance phases. These advances quencing via Microsoft HoloLens at the task area on the jobsite. Fig. 4
also allow complex models of existing buildings such as HBIM to be summarizes the process of converting the BIM model to different XR
used in XR devices to extract useful information for specialists in AEC models based on the software and apps on the market.
industry, cultural heritage documentation, preservation, and also for a
vast user community interested in cultural tourism [68]. The BIM-to-XR 4. Case study: NASA-Mars habitat project
process requires a platform/system for sharing data and collaboration
information and enabling real-time communication among different NASA invited thought leaders in industry and academia to the “3D-
stakeholders/users. There are various systems on the market for sharing Printed Habitat Challenge,” an event held to develop insights and create
BIM/XR data, but according to Banfi et al. [69], the most popular and new technologies for making a base on Mars using materials native to
easy-to-use systems are cloud-based systems such as Autodesk BIM360 the planet. An interdisciplinary team led by Northwestern faculty at-
and Autodesk Viewer. These systems combine data in a BIM model tended. The highlight was a 3D BIM model of NASA-Mars habitat de-
according to categories such as model, schedule, sheets, text, and so on, signed by the Northwestern University team that is able to use 3D
etc.) and indifferent exchange formats (such as: rvt, nwc, txt, dwg, etc.). printed using sustainable materials found on Mars. The reason for this is
Files can be communicated and share through these main databases. that NASA wants to use Mars rovers outfitted with large-scale 3D
XR technology is still in the development stage, and there are some printers to build habitats before humans even arrive. These habitats
limitations that need to be overcome. These limitations include the high must provide adequate and safe space for crews to sleep and prepare
cost of most headsets (which often rules out public access); BIM and XR meals. The habitats must protect occupants from radiation; and provide
software; and producing XR content. Other limitations include the natural light; a suitable temperature views of the Martian landscape;
confusing complexity within the BIM to XR workflow; challenges for and have comfortable living, and work areas, and operational compo-
management to see the real focus and meaning of the project; and nents.

5
S. Alizadehsalehi, et al. Automation in Construction 116 (2020) 103254

Table 2
Most common wearable devices within extended reality, 2010–2020.

* Apple AR headset will not be available until 2022–2023.

Fig. 4. BIM-to-XR toolsets workflow.

6
S. Alizadehsalehi, et al. Automation in Construction 116 (2020) 103254

Fig. 5. IDEF0 diagram for BIM-to-XR.

One task was to convert the designed BIM model by Revit 2019 of involved scientists and engineers to virtually walk on Mars and
this habitat to VR and MR models developed by the authors of this evaluate the habitat model.
article at Northwestern University. In principal, the NASA-MARS ha-
bitat XR models allowed sensing, analysis, and communication to take
4.1. Proposed BIM-to-XR IDEF0 model
place very effectively among project teams. The model created for the
meeting showed evaluators the livability, and buildability of the model,
The integrated definition function (IDEF0) model of BIM-to-XR de-
as well as provided evaluators details on the specifications and mate-
veloped and presented here has been used to clearly and explicitly
rials involved. For this reason, to execute the fastest and accurate
define the activities required for this process. IDEF0 is one of the
workflow based on the accessibility and availability of software and
methodologies that can describe the functions of manufacturing and the
hardware at Northwestern University, the authors went through the
one that can provide a mechanism for the communication of complex
following steps:
concepts through a simple use of boxes and arrows [70]. The authors
described the NASA-Mars habitat BIM-to-XR project in this model in a
(1) Identified the project scope, deadline, dedicated budget, and
way that helped all teams get a clear understanding of the processes.
available spaces.
The boxes in Fig. 5 describe key processes. As shown, Fig. 5 illustrates
(2) Recognize the required hardware, software, plugins, spaces, etc. the
all stages of creating a 3D or 4D (3D + time) model (optional) up until
executive and practical stages of converting BIM model to XR model
the time that model is used in XR for different purposes in the AEC
designed based on the integrated definition function modeling
industry.
(IDEF0) language, which called BIM-to-XR framework (Fig. 5).
The BIM-to-XR development framework encompasses five main
(3) Provided the list of most common wearable XR devices available in
activities: create a design model (A01); create a schedule (A02) (if 4D
the market (Table 2).
BIM- 4DXR is required); create an XR model (A03); import an XR model
(4) Provided the comprehensive BIM-to-XR toolsets workflow (Fig. 4).
to XR device (A04); and immerse users in an XR environment (A05).
(5) Performed a comprehensive investigation regarding XR devices
Authors created this framework for NASA-Mars habitat project but this
specifications to find the best fit for this project.
framework is applicable for all types and sizes of AEC projects. As
(6) Made conscious decisions based on the provided information from
shown in Fig. 5, numerous data are first gathered. This data includes
previous researches and current market to provide XR devices, XR
architectural, structural, and MEP design in 2D and 3D, pre-construc-
software, BIM-to-XR software/plugins, and provide the best space
tion schedules, cost estimates, and other necessity/requested informa-
location/size for creating and using the NASA-MARS habitat XR
tion. The integration of these data together leads to the creation of a
model.
federated 3D or 4D BIM Digital model (nodes A01 and A02). An XR
(7) Used selected XR devices to present the VR and MR models to allow
model is determined according to specifications, BIM knowledge, and

7
S. Alizadehsalehi, et al. Automation in Construction 116 (2020) 103254

Fig. 6. The workflow of BIM-to-VR.

ideas from designers and stakeholders (node A03). At this stage, the Finally, experiencing an exciting fully immersive BIM/VR adventure of
model is ready to use by different types of XR devices and applications NASA-Mars habitat provides substantial benefits—because everyone
(node A04). Then the created XR model can be used for analyzing the involved can see and experience the multiple design scenarios, validate
overall design and evaluating alternative design decisions with the goal design decisions, and check for possible errors before any real action
of taking corrective actions on design and making better design deci- needs to be taken. Furthermore, all involved can see the details and also
sions (node A05). Converting the BIM model to XR can happen in the the big picture of project, make changes in BIM model, and see those
real-time when the designer designs the project. changes reflected in the visualization quickly and accurately; animate
objects in the design to make the experience more realistic; deliver a
powerful presentation experience that is simple to use and easy to un-
4.2. BIM-to-VR and BIM-to-MR implementation scenarios derstand. These advantages helped the team to understand all details,
priorities, and issues to make better, more productive, and quicker
VR allowed this project's scientists, engineers, and members of other decisions.
teams to virtually walk on Mars to see how different design and con- The created MR model allowed whole teams working on this project
struction scenarios would work; compare those scenarios; and make to visualize the Mars habitat as virtual companions in the real en-
their decision to choose the most appropriate design, material, and vironment. MR can bring people together to see the same model as well
process. Fig. 6 shows the workflow of converting 3D-BIM model of the as see each other by using a hologram to discuss and presenting the
NASA-Mars habitat project to VR viewable model. This workflow starts
same design model as it would appear on-site. Fig. 7 shows the work-
with creating an information-rich 2D/3D-BIM model by Revit 2019. flow of converting BIM model of the NASA-Mars habitat project to MR
Revit is one of the BIM authoring tools helped architects and engineers viewable model. BIM-to-MR workflow starts with creating an in-
to create this model in a parametric environment. BIM 360 cloud formation-rich 2D/3D-BIM model by Revit 2019. BIM 360 cloud server/
server/database used to provide an online storing space to give real- database used to provide an online storing space to give real-time ac-
time access to all team members for this project. In the next step, Fuzor cess to all team members for this project. Cloud computing capabilities
plugin in Revit 2019, used to convert the BIM model to VR model. have leveraged communication and information exchange among
Oculus Rift, HTC Vive, and Samsung HMD utilized for this project.

8
S. Alizadehsalehi, et al. Automation in Construction 116 (2020) 103254

Fig. 7. The workflow of BIM-to-MR.

devices and teams. The next step presents a few different options like strengths and weaknesses of XR technologies. The strengths and
Microsoft 3D Viewer, HoloLive, HoloView, and Fuzor to convert the weaknesses of XR technologies have been evaluated based on three
Revit model to be MR mode, and the model is stored on the cloud, sources:
which becomes accessible from anywhere with an internet connection.
Microsoft HoloLens devices utilized as an immersive MR experience to • Academic publications (P): The authors of this article comprehen-
delivering the project. By projecting a BIM model directly over a phy- sively reviewed the most recent XR related articles between 2010
sical environment in MR, the team can evaluate the model in an im- until 2020.
mersive and interactive way. • Case study (C): The authors of this article were responsible for
converting the Northwestern NASA-Mars habitat project's BIM
model to VR and MR models and presented these models in some
5. Lessons learned: XR on construction project management
meetings. They evaluated or interviewed 40 academic and experi-
enced professionals; visited and experienced NASA models that had
Immersive experiences are changing how we connect with people,
a good level of information; and experienced different types of XR.
information, and experiences in the AEC industry. Implementing XR
helps bridge distance and address problems as never before. The high • Authors' lessons learned (A): Based on the authors' experience,
which have more than six years of practices in the area of XR
cost of goggles, PC hardware, and software are still expensive. Even if
technologies.
the software and plugins of XR have been rapidly improving in recent
few years, many BIM-authoring applications have limited or missing
support for materials and texture definitions when exporting 3Ddata for 6. Conclusion and discussion
visualization purposes. Also, the spread of data presents a new layer of
vulnerability for cyberattacks, while the high cost of implementation is BIM and various XR technologies (VR, AR, and MR) have shown
a barrier to entry for many firms. Table 3 summarizes the individual great potential to truly revolutionize how to design, build, operate, and

9
S. Alizadehsalehi, et al. Automation in Construction 116 (2020) 103254

Table 3
Summary of the strengths and weaknesses of XR technologies based on case studies and academic publications.
Strength and Weakness Brief explanation C A Academic Publications

P Reference

VR
Strengths Allows the client to experience multiple options before making final selections √ * X [55]
Shows scale and size accurately √ * X [32]
Allows for quick decision-making √ * X [36]
Creates fewer change orders during the project (Saving the client money) √ * X [56]
Gives client more necessary info and confidence when selecting contractors √ * X [55]
Creates higher client satisfaction √ * X [56]
Allows efficient translation of architectural drawings √ * X [67]
Tests the feasibility of an architectural design √ * X [61]
Decreases the risk factor in training √ * X [57]
Saves valuable man-hours √ * – –
Reduces overall costs √ * X [71]
Simulates lighting, daylighting, and textures √ * X [72]
Allows a human-scale clearance check √ * X [32]
Permits real-time virtual collaboration for stakeholders from different locations √ * X [36]
Weaknesses Does not allow interoperability from BIM to VR √ * – –
Constrains movement in the VR environment because of connection wires √ * – –
Requires the purchase of buy software, an upgraded VR-ready laptop, and a headset √ * X [32]
Requires additional time for the setup of sensors and lacks mobility √ * X [71]
Requires users to do complex procedures √ * – –

AR
Strengths Provides visual cues to help user do tasks such as maintenance, repair, or assembly √ * X [73]
Facilitates better marketing of the construction projects √ * X [49]
Enables knowledge stakeholders to assess design ideas virtually and analyze data in new format √ * – –
Allows earlier detection of design flaws √ * X [61]
Provides a method to analyze data and generate insights √ * – –
Better customer engagement √ * X [66]
Enables superior design and development √ * X [51]
Reduces errors during construction √ * X [50]
Provides realistic training √ * X [29]
Saves valuable man-hours √ * – –
Reduces overall cost √ * X [64]
Reduces risk √ * – –
Encourages collaboration and communication √ * X [74]
Helps users to visualize plans, walkthrough designs, reduce errors, and shorten design time √ * X [75]
Weaknesses Accuracy of digital model (proposed design) overlapping with the reality (as-built condition) √ * – –
File size limitation when uploading the AR model to the cloud √ * – –
It is still simply computer technology and lacks the human touch √ * – –
Aligns the virtual 3D model and the tracker image/drawing √ * – –
Has additional cost of hardware equipment (for HMD, smart glasses, and sensors) and apps √ * – –
Limited immersive experience √ * – –

MR
Strengths Allows users unlimited physical activities √ * X [43]
Provides seamless spatial interaction, allowing users to interact with 3D √ * – –
Displays virtual objects everywhere in physical space √ * X [48]
Has natural, familiar interfaces √ * – –
Provides realistic training √ * X [42]
Provides walkthrough of designs √ * X [43]
Enables collaboration and communication between stakeholders √ * X [64]
Is lighter in weight √ * – –
Uses wireless technology √ * X [76]
Contains the computer inside √ * – –
Reduces motion sickness because of real-world reference for users √ * X [43]
Rapid changes in technologies and their uses √ * – [44]
Rapid development of hardware [44]
Weaknesses Most of the MR headsets do not fit well when users wear a construction hardhat √ * – –
There is usually no tactile feedback, and HDMs are often required √ * – –
There is an interaction gap because the user has to use different devices for virtual √ * – –
There is a limited field of view (FOV) from most MR headsets √ * X [43]
There is an interaction gap in that the user uses different devices for digital objects √ * – –
Hardware landscape is changing rapidly √ * – –
Process and information exchange change rapidly √ * – [44]

Notes: A = Authors' perspective; C = Case studies; P = Academic publications.

monitor in the AEC industry. However, this mechanism is not possible solution to this problem. This research explains comprehensive process/
without having an effective integration of generating, storing, mana- steps, as well as available devices and software, suitable for any type
ging, exchanging, and sharing data. The motivation for this research and size of construction project. This study presents a novel method
came from the lack of attention paid in the literature to XR technologies that integrates BIM and XRs allowing all AEC stakeholders to obtain and
and the process of BIM-to-XR in AEC industry and research. The models, analyze data at any stage of project, which in turn can enable specialists
frameworks, and case study in this article could provide a viable to identify different scenarios at different project phases and develop

10
S. Alizadehsalehi, et al. Automation in Construction 116 (2020) 103254

Fig. 8. AEC industry roadmap.

suitable strategies. Utilizing BIM and XR together offers many benefits software, and training. Each of these categories presents unique chal-
that can improve the performance of AEC projects, including time, cost, lenges for the future of XR knowing of which is vital to improving the
quality, and safety. This integration is useful not only in the design efficiency of utilizing XR in the future of AEC industry.
phase and the construction phase but also in the maintenance phase. It is inevitable that the AEC industry will change as a result of
Additionally, the BIM-to-XR IDEF0 model proposed in this article pro- continuous progress in XR, Cloud computing system, Machine Learning
vides a viable, easier and more transparent solution. The BIM-to-VR and (ML), Artificial Intelligence (AI), and Cognitive Computing technolo-
BIM-to-MR NASA-Mars habitat case study project identified the gies. Also, increased bandwidth, speed, and improved latency that will
strengths and weaknesses of the proposed system using three different soon be provided by fifth-generation (5G) wireless technology will
resources; academic publications from 2010 to 2020, the results of in- allow XR technologies to offer novel solutions to improve remote and
terviews with 40 academic and experienced professionals, and the au- co-located creative and interactive collaboration of project teams with
thors' experiences of the field. multimodal information input (Fig. 8). The potential for data transfer
Considering current AEC industry trends in using BIM and XR speeds of up to three (3) gigabits per second means 5G should be fast
technologies, this research identify high potential but also significant enough to stream XR data from the cloud. Rather than needing to be
challenges of the BIM-to-XR in AEC field. Based on the comprehensive wired up to powerful computers, or encumbered by on-board hardware,
literature review and lessons learned from the case study, BIM-based XR viewing devices will upload tracking data to data centers where the
technologies have been introduced to a number of applications with its heavy processing will be done. These technologies will create intuitive
potential application in areas such as design management, safety design environments and spatially aware of construction automation.
management, progress monitoring, conflict avoidance, and decision BIM works as a comprehensive database and provides end-users access
making. On the other hand, the challenges can be summarized into to the latest information so that they can comprehend and perform their
three main groups of technology, content, and users. As far as content is jobs safely and efficiently. The combination of XR and BIM provides
concerned, creation of XR content and how to transfer/deliver the interactive renderings, spatial coordination, and virtual mockups. This
content to device are the main challenges. On the technology side, combination adds up to a 3D model for client deliverables that provides
access to the latest version of related technology, hardware, and soft- the ability to review using XR. This mix of XR and BIM could potentially
ware, and rapid changes in XR technologies are the main challenges. open up new opportunities and introduce new workflows into the AEC
Moreover, there are challenges from users' perspective such as the level sector. The mix will do this through the facilitation of immersive in-
acceptance/engagement of stakeholders, their awareness regarding XR, teractions with targeted objects and information in real-time, especially
software usability, and acceptance to pay additional cost of hardware, during the remote collaboration of project partners. The findings from

11
S. Alizadehsalehi, et al. Automation in Construction 116 (2020) 103254

this research could serve as a basis to close the gap in the technology construction projects, J. Constr. Eng. Manag. 140 (12) (2014) 04014056, https://
acceptance of AEC industry and pave the way for promoting tech- doi.org/10.1061/(ASCE)CO.1943-7862.0000903.
[13] P.M. Bosch-Sijtsema, P. Gluch, A.A. Sezer, Professional development of the BIM
nology-oriented industry in construction projects. actor role, Autom. Constr. 97 (2019) 44–51, https://doi.org/10.1016/j.autcon.
2018.10.024.
6.1. Future works [14] H. Mattern, M. König, BIM-based modeling and management of design options at
early planning phases, Adv. Eng. Inform. 38 (2018) 316–329.
[15] J. Tulke, BIM-based design coordination, Building Information Modeling, Springer,
The body of results shows the applicability of the BIM-to-XR in- 2018, pp. 317–327 , https://doi.org/10.1016/j.aei.2018.08.007.
tegration for a variety of AEC analysis scenarios. Future directions of [16] A. Schlueter, P. Geyer, Linking BIM and design of experiments to balance archi-
tectural and technical design factors for energy performance, Autom. Constr. 86
work focus on improving scan-to-BIM process to scan-to-XR efficiency (2018) 33–43, https://doi.org/10.1016/j.autcon.2017.10.021.
for the quality assurance of complex projects like heritage projects or [17] S. Alizadehsalehi, I. Yitmen, A concept for automated construction progress mon-
those with many MEP objects by integrating these technologies with itoring: technologies adoption for benchmarking project performance control, Arab.
J. Sci. Eng. (2018) 1–16, https://doi.org/10.1007/s13369-018-3669-1.
ML, AI, and 5G. Also, researchers might also want to investigate the
[18] N. Puri, Y. Turkan, Toward automated dimensional quality control of precast
process of 4D and 5D BIM to XR applications in different types, sizes, concrete elements using design BIM, WIT Transactions on The Built Environment
and stages of projects and enhancement of the interaction interface. 169 (2017) 203–210, https://doi.org/10.2495/BIM170191.
[19] H. Guo, Y. Yu, M. Skitmore, Visualization technology-based construction safety
management: a review, Autom. Constr. 73 (2017) 135–144, https://doi.org/10.
Declaration of competing interest 1016/j.autcon.2016.10.004.
[20] Y.-C. Lin, C.-P. Lin, H.-T. Hu, Y.-C. Su, Developing final as-built BIM model man-
agement system for owners during project closeout: a case study, Adv. Eng. Inform.
All authors have participated in (a) conception and design, or 36 (2018) 178–193, https://doi.org/10.1016/j.aei.2018.04.001.
analysis and interpretation of the data; (b) drafting the article or re- [21] P. Pishdad-Bozorgi, X. Gao, C. Eastman, A.P. Self, Planning and developing facility
vising it critically for important intellectual content; and (c) approval of management-enabled building information model (FM-enabled BIM), Autom.
Constr. 87 (2018) 22–38, https://doi.org/10.1016/j.autcon.2017.12.004.
the final version. [22] R. Sacks, C. Eastman, G. Lee, P. Teicholz, BIM Handbook: A Guide to Building
This manuscript has not been submitted to, nor is under review at, Information Modeling for Owners, Designers, Engineers, Contractors, and Facility
another journal or other publishing venue. Managers, John Wiley & Sons, 2018 ISBN: 1119287537, 9781119287537.
[23] M.C. Georgiadou, An overview of benefits and challenges of building information
modelling (BIM) adoption in UK residential projects, Constr. Innov. (2019), https://
Acknowledgment doi.org/10.1108/CI-04-2017-0030.
[24] S. Pittard, P. Sell, BIM and Quantity Surveying, Routledge, 2017 ISBN:
9781315677361.
The authors would like to thank Prof. Gianluca Cusatis and the Civil
[25] C. Preidel, A. Borrmann, C. Oberender, M. Tretheway, Seamless Integration of
and Environmental Engineering NASA Mars Habitat research team at Common Data Environment Access into BIM Authoring Applications: The BIM
Northwestern University for providing the habitat model for the case Integration Framework, (2015) (ISBN: 1315386895, 9781315386898).
study and all participating specialists and respondents who contributed [26] I.J. Palomar, J.L.G. Valldecabres, P. Tzortzopoulos, E. Pellicer, An online platform
to unify and synchronise heritage architecture information, Autom. Constr. 110
to or participated in this research. (2020) 103008, https://doi.org/10.1016/j.autcon.2019.103008.
[27] C. Preidel, A. Borrmann, H. Mattern, M. König, S.-E. Schapke, Common data en-
References vironment, Building Information Modeling, Springer, 2018, pp. 279–291 ISBN: 978-
3-319-92862-3.
[28] B. Coleman, Using sensor inputs to affect virtual and real environments, IEEE
[1] R. Volk, J. Stengel, F. Schultmann, Building information modeling (BIM) for ex- Pervasive Computing 8 (3) (2009) 16–23, https://doi.org/10.1109/MPRV.2009.60.
isting buildings—literature review and future needs, Autom. Constr. 38 (2014) [29] X. Li, W. Yi, H.L. Chi, X. Wang, A.P. Chan, A critical review of virtual and aug-
109–127, https://doi.org/10.1016/j.autcon.2013.10.023. mented reality (VR/AR) applications in construction safety, Autom. Constr. 86
[2] M. Scheffer, H. Mattern, and M. König, "BIM project management, " in Building (2018) 150–162, https://doi.org/10.1016/j.autcon.2017.11.003.
Information Modeling: Springer, 2018, pp. 235–249. ISBN: 978-3-319-92862-3. [30] M. Fu, R. Liu, The application of virtual reality and augmented reality in dealing
[3] S. Alizadehsalehi, I. Yitmen, The impact of field data capturing technologies on with project schedule risks, Construction Research Congress 2018, 2018, pp.
automated construction project Progress monitoring, Procedia Engineering 161 429–438 , https://doi.org/10.1061/9780784481264.042.
(2016) 97–103, https://doi.org/10.1016/j.proeng.2016.08.504. [31] A.A. Muhammad, I. Yitmen, S. Alizadehsalehi, T. Celik, Adoption of virtual reality
[4] C. Bianchini, C. Inglese, A. Ippolito, D. Maiorino, L.J. Senatore, Building informa- (VR) for site layout optimization of construction projects, Teknik Dergi 31 (2)
tion modeling (BIM): great misunderstanding or potential opportunities for the (2019), https://doi.org/10.18400/tekderg.423448.
design disciplines? Handbook of Research on Emerging Technologies for Digital [32] S. Alizadehsalehi, A. Hadavi, J.C. Huang, Virtual reality for design and construction
Preservation and Information Modeling, IGI Global, 2017, pp. 67–90 , https://doi. education environment, AEI 2019, American Society of Civil Engineers, Reston, VA,
org/10.4018/978-1-5225-0680-5.ch004. 2019, pp. 193–203 , https://doi.org/10.1061/9780784482261.023.
[5] S. Azhar, Building information modeling (BIM): trends, benefits, risks, and chal- [33] A.G. Sutcliffe, C. Poullis, A. Gregoriades, I. Katsouri, A. Tzanavari, K. Herakleous,
lenges for the AEC industry, Leadersh. Manag. Eng. 11 (3) (2011) 241–252, https:// Reflecting on the design process for virtual reality applications, International
doi.org/10.1061/(ASCE)LM.1943-5630.0000127. Journal of Human–Computer Interaction 35 (2) (2019) 168–179, https://doi.org/
[6] C. Sun, S. Jiang, M.J. Skibniewski, Q. Man, L. Shen, A literature review of the 10.1080/10447318.2018.1443898.
factors limiting the application of BIM in the construction industry, Technol. Econ. [34] S. Romano, N. Capece, U. Erra, G. Scanniello, M. Lanza, On the use of virtual reality
Dev. Econ. 23 (5) (2017) 764–779, https://doi.org/10.3846/20294913.2015. in software visualization: the case of the city metaphor, Inf. Softw. Technol. (2019),
1087071. https://doi.org/10.1016/j.infsof.2019.06.007.
[7] F.P. Rahimian, S. Seyedzadeh, S. Oliver, S. Rodriguez, N. Dawood, On-demand [35] R. Bille, S.P. Smith, K. Maund, G. Brewer, Extending building information models
monitoring of construction projects through a game-like hybrid application of BIM into game engines, Proceedings of the 2014 Conference on Interactive
and machine learning, Autom. Constr. 110 (2020) 103012, https://doi.org/10. Entertainment, ACM, 2014, pp. 1–8 , https://doi.org/10.1145/2677758.2677764.
1016/j.autcon.2019.103012. [36] J. Du, Z. Zou, Y. Shi, D. Zhao, Zero latency: real-time synchronization of BIM data in
[8] P. Saieg, E.D. Sotelino, D. Nascimento, R.G.G. Caiado, Interactions of building in- virtual reality for collaborative decision-making, Autom. Constr. 85 (2018) 51–64,
formation modeling, lean and sustainability on the architectural, engineering and https://doi.org/10.1016/j.autcon.2017.10.009.
construction industry: a systematic review, J. Clean. Prod. 174 (2018) 788–806, [37] S. Rankohi, L. Waugh, Review and analysis of augmented reality literature for
https://doi.org/10.1016/j.jclepro.2017.11.030. construction industry, Visualization in Engineering 1 (1) (2013) 9, https://doi.org/
[9] A.I. Martina Attenni, C. Bianchini, HBIM ovvero un modello informativo per l’e- 10.1186/2213-7459-1-9.
dificio storico = HBIM: an information model for historical building, In Reflections: [38] D.H. Shin, P.S. Dunston, Identification of application areas for augmented reality in
The Art of Drawing/The Drawing of Art, Gangemi, 2019, pp. 285–296 , https://doi. industrial construction based on technology suitability, Autom. Constr. 17 (7)
org/10.36165/1123. (2008) 882–894, https://doi.org/10.1016/j.autcon.2008.02.012.
[10] A. di Luggo, D. Palomba, M. Pulcrano, S. Scandurra, Theoretical and methodolo- [39] A.H. Behzadan, ARVISCOPE: georeferenced visualization of dynamic construction
gical implications in the information modelling of architectural heritage, Impact of processes in three-dimensional outdoor augmented reality, https://deepblue.lib.
Industry 4.0 on Architecture and Cultural Heritage, IGI Global, 2020, pp. 20–48 , umich.edu/handle/2027.42/60761?show=full, (2008).
https://doi.org/10.4018/978-1-7998-1234-0.ch002. [40] P. Milgram, H. Colquhoun, A taxonomy of real and virtual world display integra-
[11] C. Bianchini, S. Nicastro, From BIM to H-BIM, 2018 3rd Digital Heritage tion, Mixed Reality: Merging Real and Virtual Worlds, 1 1999, pp. 1–26 http://
International Congress (DigitalHERITAGE) Held Jointly with 2018 24th citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.32.6230&rep=rep1&type=
International Conference on Virtual Systems & Multimedia (VSMM 2018), IEEE, pdf.
2018, pp. 1–4 , https://doi.org/10.1109/DigitalHeritage.2018.8810087. [41] X. Wang, P.S. Dunston, User perspectives on mixed reality tabletop visualization for
[12] D. Cao, H. Li, G. Wang, Impacts of isomorphic pressures on BIM adoption in face-to-face collaborative design review, Autom. Constr. 17 (4) (2008) 399–412,

12
S. Alizadehsalehi, et al. Automation in Construction 116 (2020) 103254

https://doi.org/10.1016/j.autcon.2007.07.002. research tool—exploring user experience in a real building and a corresponding

[42] J. Chalhoub, S.K. Ayer, Using mixed reality for electrical construction design virtual model, Comput. Environ. Urban. Syst. 54 (2015) 363–375, https://doi.org/
communication, Autom. Constr. 86 (2018) 1–10, https://doi.org/10.1016/j.autcon. 10.1016/j.compenvurbsys.2015.09.006.
2017.10.028. [61] M.E. Portman, A. Natapov, D. Fisher-Gewirtzman, To go where no man has gone
[43] S. Alizadehsalehi, A. Hadavi, J.C. Huang, BIM/MR-lean construction project de- before: virtual reality in architecture, landscape architecture and environmental
livery management system, 2019 IEEE Technology & Engineering Management planning, Comput. Environ. Urban. Syst. 54 (2015) 376–384, https://doi.org/10.
Conference (TEMSCON), IEEE, 2019, pp. 1–6 , https://doi.org/10.1109/TEMSCON. 1016/j.compenvurbsys.2015.05.001.
2019.8813574. [62] A. Heydarian, J.P. Carneiro, D. Gerber, B. Becerik-Gerber, T. Hayes, W. Wood,
[44] J.C. Cheng, K. Chen, W. Chen, State-of-the-art review on mixed reality applications Immersive virtual environments versus physical built environments: a bench-
in the AECO industry, J. Constr. Eng. Manag. 146 (2) (2020) 03119009 , https:// marking study for building design and user-built environment explorations, Autom.
doi.org/10.1061/(ASCE)CO.1943-7862.0001749. Constr. 54 (2015) 116–126, https://doi.org/10.1016/j.autcon.2015.03.020.
[45] Y. Shi, J. Du, E. Ragan, K. Choi, S. Ma, Social influence on construction safety [63] A.Z. Sampaio, O.P. Martins, The application of virtual reality technology in the
behaviors: a multi-user virtual reality experiment, Construction Research Congress construction of bridge: the cantilever and incremental launching methods, Autom.
2018, 2018, pp. 174–183 , https://doi.org/10.1061/9780784481288.018. Constr. 37 (2014) 58–67, https://doi.org/10.1016/j.autcon.2013.10.015.
[46] Y. Mo, D. Zhao, J. Du, W. Liu, A. Dhara, Data-driven approach to scenario de- [64] X. Wang, M. Truijens, L. Hou, Y. Wang, Y. Zhou, Integrating augmented reality with
termination for VR-based construction safety training, Construction Research building information modeling: onsite construction process controlling for liquefied
Congress 2018, 2018, pp. 116–125 , https://doi.org/10.1061/9780784481288.012. natural gas industry, Autom. Constr. 40 (2014) 96–105, https://doi.org/10.1016/j.
[47] A. Olorunfemi, F. Dai, L. Tang, Y. Yoon, Three-dimensional visual and collaborative autcon.2013.12.003.
environment for jobsite risk communication, Construction Research Congress 2018, [65] R. Sacks, A. Perlman, R. Barak, Construction safety training using immersive virtual
2018, pp. 345–355 , https://doi.org/10.1061/9780784481288.034. reality, Constr. Manag. Econ. 31 (9) (2013) 1005–1017, https://doi.org/10.1080/
[48] J. Chalhoub, S. Alsafouri, S.K. Ayer, Leveraging site survey points for mixed reality 01446193.2013.828844.
BIM visualization, Construction Research Congress 2018, 2018, pp. 326–335 , [66] X. Wang, P.S. Dunston, Tangible mixed reality for remote design review: a study
https://doi.org/10.1061/9780784481264.032. understanding user perception and acceptance, Visualization in Engineering 1 (1)
[49] M. Chu, J. Matthews, P.E. Love, Integrating mobile building information modelling (2013) 8, https://doi.org/10.1186/2213-7459-1-8.
and augmented reality systems: an experimental study, Autom. Constr. 85 (2018) [67] J. Goulding, W. Nadim, P. Petridis, M. Alshawi, Construction industry offsite pro-
305–316, https://doi.org/10.1016/j.autcon.2017.10.032. duction: a virtual reality interactive training environment prototype, Adv. Eng.
[50] L. Hou, H.-L. Chi, W. Tarng, J. Chai, K. Panuwatwanich, X. Wang, A framework of Inform. 26 (1) (2012) 103–116, https://doi.org/10.1016/j.aei.2011.09.004.
innovative learning for skill development in complex operational tasks, Autom. [68] L. Barazzetti, F. Banfi, Historic BIM for mobile VR/AR applications, Mixed Reality
Constr. 83 (2017) 29–40, https://doi.org/10.1016/j.autcon.2017.07.001. and Gamification for Cultural Heritage, Springer, 2017, pp. 271–290 , https://doi.
[51] A. Piroozfar, A. ESSA, E.R. Farr, The Application of Augmented Reality and Virtual org/10.1007/978-3-319-49607-8_10.
Reality in the Construction Industry Using Wearable Devices, (2017) (ISBN: [69] F. Banfi, R. Brumana, C. Stanga, Extended Reality and Informative Models for the
9780998752501). Architectural Heritage: From Scan-to-BIM Process to Virtual and Augmented
[52] J. Du, Z. Zou, Y. Shi, D. Zhao, Simultaneous data exchange between BIM and VR for Reality, (2019) (ISSN-e 1989-9947).
collaborative decision making, Computing in Civil Engineering 2017, 2017, pp. 1–8 [70] G.R. Waissi, M. Demir, J.E. Humble, B. Lev, Automation of strategy using IDEF0—a
, https://doi.org/10.1061/9780784480830.001. proof of concept, Operations Research Perspectives 2 (2015) 106–113, https://doi.
[53] S. Azhar, Role of visualization technologies in safety planning and management at org/10.1016/j.orp.2015.05.001.
construction jobsites, Procedia engineering 171 (2017) 215–226, https://doi.org/ [71] L.A. Pratama, C.S. Dossick, Workflow in virtual reality tool development for AEC
10.1016/j.proeng.2017.01.329. industry, Advances in Informatics and Computing in Civil and Construction
[54] R. Klempous, K. Kluwak, R. Idzikowski, T. Nowobilski, T. Zamojski, Possibility Engineering, Springer, 2019, pp. 297–306 , https://doi.org/10.1007/978-3-030-
analysis of danger factors visualization in the construction environment based on 00220-6_36.
virtual reality model, Cognitive Infocommunications (CogInfoCom), 2017 8th IEEE [72] W. Natephra, A. Motamedi, T. Fukuda, N. Yabuki, Integrating building information
International Conference on, IEEE, 2017, pp. 000363–000368 , https://doi.org/10. modeling and virtual reality development engines for building indoor lighting de-
1109/CogInfoCom.2017.8268271. sign, Visualization in Engineering 5 (1) (2017) 19, https://doi.org/10.1186/
[55] D. Paes, E. Arantes, J. Irizarry, Immersive environment for improving the under- s40327-017-0058-x.
standing of architectural 3D models: comparing user spatial perception between [73] J. Jetter, J. Eimecke, A. Rese, Augmented reality tools for industrial applications:
immersive and traditional virtual reality systems, Autom. Constr. 84 (2017) what are potential key performance indicators and who benefits? Comput. Hum.
292–303, https://doi.org/10.1016/j.autcon.2017.09.016. Behav. 87 (2018) 18–33, https://doi.org/10.1016/j.chb.2018.04.054.
[56] K.E. Haggard, Case Study on Virtual Reality in Construction, https:// [74] M. Arashpour, G. Aranda-Mena, Curriculum renewal in architecture, engineering,
digitalcommons.calpoly.edu/cmsp/54, (2017). and construction education: visualizing building information modeling via aug-
[57] M.A. Froehlich, S. Azhar, Investigating virtual reality headset applications in con- mented reality, 9th International Structural Engineering and Construction
struction, Proc., Proceedings of the 52nd ASC International Conference, Provo, UT, Conference: Resilient Structures and Sustainable Construction, ISEC 2017, ISEC
2016 http://ascpro0.ascweb.org/archives/cd/2016/paper/CPRT195002016.pdf. Press, 2017(ISBN: 978-0-9960437-4-8).
[58] S. Niu, W. Pan, Y. Zhao, A virtual reality integrated design approach to improving [75] F. Bademosi, R.R. Issa, Implementation of augmented reality throughout the life-
occupancy information integrity for closing the building energy performance gap, cycle of construction projects, Advances in Informatics and Computing in Civil and
Sustain. Cities Soc. 27 (2016) 275–286, https://doi.org/10.1016/j.scs.2016.03.010. Construction Engineering, Springer, 2019, pp. 307–313 , https://doi.org/10.1007/
[59] D. Zhao, J. Lucas, Virtual reality simulation for construction safety promotion, Int. 978-3-030-00220-6_37.
J. Inj. Control Saf. Promot. 22 (1) (2015) 57–67, https://doi.org/10.1080/ [76] K. El Ammari, A. Hammad, Remote interactive collaboration in facilities manage-
17457300.2013.861853. ment using BIM-based mixed reality, Autom. Constr. 107 (2019) 102940, https://
[60] S.F. Kuliga, T. Thrash, R.C. Dalton, C. Hoelscher, Virtual reality as an empirical doi.org/10.1016/j.autcon.2019.102940.

13