RIVERS STATE UNIVERSITY

Nkpolu - Oroworukwo P.M.B. 5080 Port Harcourt, Rivers State Nigeria

ASSIGNMENT
 Look for various statistical test, discuss at least 5 and how they can be applied to research
problems in the construction industry

 Pick one of those research problems and draft a questionnaire

 Do a critical literature review on your chosen topic and based on an empirical work on
your topic

 Prepare a reference list using the HAVAD reference system

PRESENTED BY

NAME: GENTLE MARYANGEL TAMUNOIBUOMIE

MATRIC NUMBER: DE.2020/5666

COURSE: RESEARCH METHODOLOGY

DEPARTMENT: QUANTITY SURVEYING

17th April, 2024

There are many different types of statistical tests, each designed to answer specific questions or test specific
hypotheses. Some common types of statistical tests include:

1. Chi test:

The Chi-squared test is a statistical test used to determine whether there is a significant association between
two categorical variables. It is often used to analyze data in contingency tables, which display the frequency
distribution of two or more categorical variables. There are two main types of Chi-squared tests:

Chi-squared test for independence: This test is used to determine whether there is a significant association
between two categorical variables. It assesses whether the observed frequency distribution differs from the
expected frequency distribution under the assumption that the two variables are independent.

Chi-squared goodness-of-fit test: This test is used to determine whether an observed frequency
distribution differs from a theoretical or expected frequency distribution. It is often used to compare the
observed frequencies to the frequencies that would be expected if the data followed a specific distribution.

Both types of Chi-squared tests involve calculating a test statistic (chi-squared statistic) and comparing it
to a critical value from the chi-squared distribution to determine statistical significance. If the test statistic
is greater than the critical value, the null hypothesis (of independence or goodness-of-fit) is rejected,
suggesting that there is a significant association or difference, respectively, between the variables.

2. Correlation Test:

A correlation test is a statistical method used to evaluate the strength and direction of a relationship between
two variables. The most common correlation coefficient is Pearson’s correlation coefficient, which
measures the linear relationship between two continuous variables. Other types of correlation coefficients
include Spearman’s rank correlation coefficient, which assesses the monotonic relationship between two
variables, and Kendall’s tau, which also measures the ordinal association between two variables.
Correlation tests help researchers understand how variables are related and can be used to make predictions
or identify patterns in data.

3. Regression test: Regression analysis is a statistical method used to examine the relationship

between one dependent variable and one or more independent variables. It aims to model the dependent
variable as a function of the independent variables, making it possible to predict the value of the dependent
variable based on the values of the independent variables. There are several types of regression analysis,
including:

Linear Regression: It assumes a linear relationship between the dependent and independent variables. The
goal is to find the best-fitting straight line through the data points.

 Multiple Regression: It involves more than one independent variable. The model is expressed as

Y = β0 + β1X1 + β2X2 + … + βnXn + ε, where Y is the dependent variable, Xi are the independent
variables, βi are the coefficients, and ε is the error term.

 Logistic Regression: It is used when the dependent variable is binary (e.g., yes/no, 0/1). It models

the probability that the dependent variable belongs to a particular category.

 Polynomial Regression: It is used when the relationship between the dependent and independent
variables are nonlinear. It fits a polynomial function to the data.

Regression analysis helps researchers understand the relationships between variables, make predictions,
and test hypotheses.

1. ANOVA (Analysis of Variance):

ANOVA (Analysis of Variance) is a statistical test used to analyze the difference in means among three or
more groups. It compares the means by analyzing the variance between groups relative to the variance
within groups.

ANOVA tests the null hypothesis that the means of the groups are equal, against the alternative hypothesis
that at least one of the group means is different. If the p-value associated with the ANOVA test is less than
a predetermined significance level (often 0.05), then the null hypothesis is rejected, and it can be concluded
that there is a significant difference in at least one of the group means. There are several types of ANOVA
tests:

 One-Way ANOVA: Compares the means of three or more independent (unrelated) groups to

determine if at least one of the groups is significantly different from the others.

 Two-Way ANOVA: Examines the interaction effects between two independent variables on a

dependent variable. It is used when there are two independent variables and one dependent variable.

 Repeated Measures ANOVA: Compares the means of three or more dependent (related) groups

to determine if there are differences between the groups over time or under different conditions.

ANOVA is a widely used statistical test in fields such as psychology, biology, economics, and sociology
to compare means across multiple groups and conditions.

2. T- test

The t-test is a statistical test used to determine if there is a significant difference between the means of two
groups. It is based on the assumption that the data is normally distributed and that the variances of the two
groups are equal. There are two main types of t-tests:

 Independent Samples t-test: This test is used when comparing the means of two independent

groups. For example, you might use an independent samples t-test to compare the average test scores of
students who received a special tutoring program to those who did not.

 Paired Samples t-test: This test is used when comparing the means of two related groups. For

example, you might use a paired samples t-test to compare the blood pressure of individuals before and
after a treatment. The t-test calculates a t-value, which is then compared to a critical value from the t-
distribution to determine if the difference between the two means is statistically significant. If the t-value
is greater than the critical value, the difference is considered statistically significant.

Z-test: The Z-test is a statistical test used to determine if there is a significant difference between a sample
mean and a known population mean when the population standard deviation is known. It is based on the
standard normal distribution (z-distribution). The Z-test is often used in hypothesis testing, particularly
when dealing with large sample sizes. The steps involved in conducting a Z-test are similar to those of a t-
test:

 Formulate the null and alternative hypotheses: The null hypothesis (H0) typically states that

there is no significant difference between the sample mean and the population mean, while the alternative
hypothesis (H1) states that there is a significant difference.

 Calculate the Z-score: The Z-score is calculated as (sample mean – population mean) / (population

standard deviation / √n), where n is the sample size.

 Determine the critical value: The critical value is obtained from the standard normal distribution

table based on the desired level of significance (e.g., 0.05 for a 95% confidence level).

Compare the Z-score to the critical value: If the Z-score is greater than the critical value (for a one-tailed
test) or falls outside the critical values (for a two-tailed test), then the null hypothesis is rejected in favor of
the alternative hypothesis. The Z-test is commonly used in quality control, market research, and other fields
where large sample sizes are available and the population standard deviation is known.

Statistical tests can be applied to research problems in the construction industry in various ways, including:

1. Quality Control: Statistical tests can be used to analyze data related to construction materials,

such as concrete strength or steel quality, to ensure they meet required standards

2. Cost Estimation: Statistical analysis can help in estimating construction costs by analyzing

historical data, identifying cost drivers, and predicting future costs.

3. Project Management: Statistical tests can be used to analyze project schedules, identify critical

paths, and assess project risks.

4. Safety Analysis: Statistical methods can be applied to analyze accident data, identify safety

trends, and develop strategies to improve safety on construction sites.

5. Performance Evaluation: Statistical tests can be used to evaluate the performance of construction

projects, contractors, and suppliers based on key performance indicators.

Research Questionnaire

The effect of effective communication among team members on the construction site
Thank you for taking the time to participate in this survey. Your insights are invaluable in identifying and
addressing issues on construction sites. Please answer the following questions to the best of your ability.
All responses will be kept confidential and used for research purposes only.
1. General Information
What is your role on the construction site?
Project Manager Site Supervisor Foreman
Construction Worker Engineer Other(please specify)
How long have you been working in the construction industry?
Less than 1 year 1-5 years
5-10 years More than 10 years
2. Experience and background
How long has your company been involved in construction projects?
_____________________________________________________________________________________
How many BIM projects has your company completed?
_____________________________________________________________________________________

What types of projects have you implemented BIM in (e.g., residential, commercial, infrastructure)?
_____________________________________________________________________________________

What BIM software tools does your company commonly use?

___________________________________________________________________________________
Have you ever witnessed or experienced a safety incident on the construction site? If yes, please briefly
describe.
_____________________________________________________________________________________
_____________________________________________________________________________________
3. Team Composition
How many BIM specialists does your company employ?
_____________________________________________________________________________________
What are the qualifications and certifications of your BIM team members?
_____________________________________________________________________________________
How do you ensure continuous training and skill development for your BIM team?
_____________________________________________________________________________________
4. BIM Implementation Process
Can you describe your typical process for implementing BIM in a construction project?
_____________________________________________________________________________________
How do you integrate BIM into the overall project management and collaboration process?
_____________________________________________________________________________________
5. Equipment and Machinery
Are there any common problems with equipment or machinery on the construction site? If yes, please
describe.
6. Future Outlook
How do you envision the role of BIM evolving in the construction industry in the coming years?
_____________________________________________________________________________________
What steps are you taking to ensure your company remains at the forefront of BIM innovation and
proficiency?
_____________________________________________________________________________________
7. Worker Training and Skills
Are there any skill gaps or training needs among the construction workforce?
Yes No
What training programs or initiatives would you recommend to enhance worker skills and efficiency?
8. Challenges and Lessons Learned
What are some common challenges you have encountered in implementing BIM, and how have you
addressed them?
_____________________________________________________________________________________
What lessons have you learned from previous BIM projects that have influenced your approach to future
projects?
_____________________________________________________________________________________
_____________________________________________________________________________________
How do you adapt your BIM strategies to accommodate project-specific requirements or constraints?
____________________________________________________________________________________
Thank you for taking the time to complete this questionnaire. Your feedback is valuable for our research
EVALUATING CONTRACTORS’ PROFICIENCY IN BIM

LITERATURE REVIEW

INTRODUCTION

Construction has evolved through the adoption of new methods, the maturity of management skills,
and especially through the development of new technologies. In particular, Building Information Modeling
(BIM) is the most effective technology that further develops and enhances the construction process (Azhar
2011; Eastman et al. 2011). Cost, schedule, productivity, and facility management (FM) are the major areas
that have direct correlation to the use of BIM technology. Such advantages are seen through the increase of
building performance, the reduction of the financial risk and project schedules, the attainment of reliable
and accurate cost estimates, the assurance of program compliance, and the optimization of facility
management and maintenance (Eastman et al. 2011; McGraw-Hill 2009). Since there are many benefits of
BIM usage from the pre-construction through the post-construction phase, its usage has increased
exponentially throughout the construction industry (Azhar 2011). According to McGraw-Hill Construction
Company (2012), the level of BIM adoption in North America was 28% in 2007, increasing to 49% in 2009
and to 71% in 2012. Clearly, the adoption of BIM has expanded dramatically between 2007 and 2012.
Several top companies, as well as mid-size companies, have now adopted BIM for their construction
projects. According to the BIM handbook, owners reap benefits in project quality, cost, 2 and operation of
the facility (Eastman et al. 2011). BIM-based process phases increase the value of project information,
which in turn improves the collaboration and efficiency of the project team (McGraw-Hill 2009), thus
overall project productivity is increased, and cost and time are saved to reduce the need for re-work
(Eastman et al. 2011). Moreover, owners can better comprehend designs due to BIM visualization,
problems from incomplete documents are less frequent during construction, and the project allows for
better-constructed and well-reasoned designs (McGraw-Hill 2014). Owners can find optimized facilities
management techniques by exporting relevant BIM data to start the system and maintain them over the
lifecycle of the facilities (Eastman et al. 2011). BIM improves the processes of projects as owners receive
a greater return in their investments. For the aforementioned benefits, a growing number of companies and
owners are interested in investing in BIM (Mayo et al. 2012; McGraw-Hill 2009). However, the challenge
lies in selecting competent contractors for owners because owners may not have enough contextual
understanding of BIM

CONTRACTOR EVALUATION MODELS

Many studies about gauging the contractors’ capabilities have been conducted by institutes and
universities; as a result, several evaluation methods are available for assessing a contractor’s BIM
proficiency. Among several tools, the following four evaluation systems and tools are analyzed: CIC
Research Group’s Scoring Matrix, bimSCORE, Vico’s BIM scorecard, and Indiana University’s BIM
Proficiency Matrix. 2.1 Scoring Matrix Computer Integrated Construction (CIC) Research Group at
Pennsylvania State University (2012) introduced Scoring Matrix through the guideline named “BIM
planning Guide for Facility Owners”. To ensure the success of a BIM project, project team members are
required to possess adequate skills about BIM and owners should select proper contractors who have
proficiency in BIM (CIC Research Group 2012). The Request for Qualifications (RFQ) allows owners to
understand the contractor’s BIM experiences and abilities. Through the RFQ, owners should be able to
determine a contractor’s competence to implement BIM projects, abilities for collaboration with 8 other
firms, compliance with minimum BIM requirements, and experience in BIM Project Execution Planning.
Scoring Matrix is a tool to help owners determine the contractors’ level of BIM capabilities and skills when
it is difficult to evaluate them. This matrix assists the owners to organize the submitted contractor’s RFQ
with a quantifiable score that can be ranked quickly and easily (CIC Research Group 2012). It contains two
kinds of scoring matrices: BIM Qualifications Scoring Matrix and Proposal Scoring Matrix

IU’s BIM Proficiency Matrix (BPM)

Indiana University (IU) (2012b) created their own evaluation matrix called “BIM Proficiency Matrix
(BPM)” for measuring the expertise of a contractor in terms of using a BIM process on IU projects. BPM
includes eight main categories: Physical Accuracy of Model, IPD Methodology, FM Data Richness,
Construction Data, As-Build Modeling, Content Creation, Location Awareness, and Calculation Mentality.
Each category is divided into four maturity areas. The applicants for IU projects fill out the matrix on the
basis of their experience and capabilities. Then, their answers are evaluated by a consultant from IU.
Scores are earned by one point per area and the scores are then all added up. All questions are weighted
equally and the maximum score 32 since the matrix contains eight categories with four maturity levels
(see fig. 6). By using BMP, IU can filter out an applicant who has a high level of BIM proficiency (Indiana
University 2012b). It takes much time to fill out the matrix, so it may not be useful when an owner is
interviewing a contractor.

Additionally, bimSCORE and Vico’s scorecard are self-grading systems that must be completely
used with owners’ discretion. Since the scores are calculated solely based on the participants’ answers, it
would be risky for the owners to depend entirely on the score. If contractors are selected by these scores, it
is possible that the contractors exaggerated their BIM proficiency levels. Also, the questions in those
systems are multiple-choice questions, as opposed to open-ended questions, providing less opportunity for
the contractors to show extensive understanding of BIM. Thus, these two scores may not be as efficient and
useful for owners during an interview. Regarding IU’s BPM, after the contractors fill out the matrix, the
responses should be scored by BIM experts. Since this tool does not include the standards for judging a
contractor’s answers, owners need knowledge about BIM to judge the responses. However, most owners
may not have enough knowledge and experience on BIM and it would be challenging for owners to grade
the contractors’ responses. These weaknesses in the currently available BIM evaluations demonstrate the
need for an improved method of evaluating a contractor’s BIM proficiency. The next chapter will explore
a possible solution.

General Buildings Information Handover Guide

NIST The National Institute of Standards and Technology (NIST) introduced the guideline for
general building information handover including principles, methodology and case studies (NIST 2007).
According to this manual, “The purpose of this guide is to assist users and developers of building
information systems in the general buildings industry in making good use of advanced technology and
avoiding the pitfalls, particularly those encountered in information handovers between parties”. The
significant aspect of BIM in this manual is to assist the BIM users in enhancing the data interoperability
and improving management of the model with advanced technology. Also, each project process is laced
with specific information for implementing BIM projects for thorough comprehension. The guideline
provides six case studies that used advanced technology and electronic handover to quantify shortening
construction schedule and saving costs. These cases help readers to better understand how to use
technologies and assess their benefits. Some ideas are addressed from the owner’s perspective, for example,
the owner’s strategies for information handover. Overall contents in the manual support the organization
and owner with enhancing the 37 interoperability, providing information strategies, and suggesting the best
implementation of the project information handover (NIST 2007). This guide does not contain any
information that would help owners to select competent contractors. This guideline mainly focuses on
explaining the general information, key concepts, technical terminology, and industry background of BIM.
Since the manual rarely mentions the requirements for performing BIM projects, the manual was not
analyzed.

LACCD BIM Standards

Los Angeles Community College District (LACCD) (2011) published the guideline titled “LACCD
Building Information Modeling Standards”. This manual had been developed to enable the use of BIM
technology for improving system coordination, utilization of 4D and 5D technology, and sustainable
construction. Also, the LACCD had tried to establish requirement procedures in the various stages of their
projects in terms of using BIM. This guideline consists of four main chapters: Introduction, BIM project
requirements, BIM process and implementation, and Quality assurance and Implementation. In the
introductory chapter, the overview and main objectives of the manual are stated. The BIM project
requirements chapter contains the mandatory BIM project requirements for their projects and the
management of project files. BIM workflow process, team collaboration procedure, BIM execution plan,
and roles and responsibilities are mentioned in chapter 3. Lastly, the process of quality assurance and
validation is included in chapter 4 (LACCD 2011). This manual thoroughly focuses on 38 the requirements
for their projects. However, it was challenging to find the information that could be helpful to evaluate a
contractor’s level of proficiency in BIM.

RESULTS AND DISCUSSION

This research consists of outcome and discussion sections. The first section covers the results of
the in-depth interviews in usability assessment. Included is the feasibility of the questionnaire, suitability
of the question contents, and suggestions for the questionnaire. Next, the discussion section organizes the
opinions or feedback from experts about suitability of individual questions in the questionnaire. It also
includes data about the necessity of question revision or relevance in the scope of the entire questionnaire.
6.1 Results The audio file that was recorded during the interviews with SMEs was transcribed and analyzed
to understand the usability of the questionnaire and achieve advices for developing the questionnaire. The
findings from interviews were grouped into related topics of interests. The topics are as follows: 1. Whether
or not the questionnaire is feasible to be used for evaluating contractors’ proficiency in BIM. 2. The
questionnaire contains related contents that owners wish to inquire of contractors. 70 3. Any suggestions or
feedback from experts that will help develop the questionnaire. 6.1.1 Feasibility of the Questionnaire The
participants were provided the background and objective of this research, current evaluating systems, the
general concept of the questionnaire, and such to better understand the research topic; next, they were given
the questionnaire. Finally, they were asked about feasibility and applicability of the questionnaire.
Interviewee 1, the Innovations Director, stated that this questionnaire has potential but it provides
challenges, such as considering the owners’ the level of knowledge about BIM. When owners ask questions
using the questionnaire and receive responses from the contractors, the owners need to be more technical
to better understand the data. Additionally, if the owners have proficient BIM knowledge, they do not need
the questionnaire because they already know what questions they should ask for determining the
contractors’ level of proficiency in BIM. So, this questionnaire would be helpful but it should be adjusted
to be able to use by the non-technical owner. Interviewee 2, the BIM Manager, stated that the questionnaire
is overwhelming but its extensive coverage is beneficial in its details and applicability. Also, the interviewee
said “It is going to be applicable depends on projects to projects, and people to people who will be using
it.” It means that sine the every project has own specific challenges, the questions should be specified
depends on projects, market place and client type. 71 Interviewee 3, the Senior Program Manager,
mentioned that “when selecting or considering a contractor, the owner may best be served by asking for
this information as part of his proposal or bidding requirements.” Moreover, the interviewee said that
interviews utilizing this questionnaire have contractors explain their information or qualifications with more
flexibility and in detail. Since the owners judge the contractors’ communication skills, creative thinking,
organizational skills, etc. through interviews, it would prove to be beneficial to owners. Interviewee 4, the
BIM Engineer, stated that “this is not always the case when qualifying contractors. The most of the time,
hard copies of proposals are presented for RFPs.” This implies that the questionnaire could be a part of the
RFP as a separate attachment for the contractors to complete. Interviewee 5, the Pre-Construction Manager,
mentioned that “Yes, there needs to be a way for contractors to get feedback on these BIM services.” It
means that the questionnaire would be utilized not only for owners to evaluate contractors’ level of
proficiency in BIM but also for contractors to assess their projects for better services in the future.

CONCLUSION

BIM usage in construction projects has been flourishing, as well as owners’ demands in adopting BIM
technology for their projects. However, many project owners do not possess sufficient BIM knowledge or
experience, leading them to ineffectively select competent contractors to execute BIM projects. Although
several contracting evaluation systems had been introduced for qualifying contractors, some tools were
required enough knowledge and experience about BIM to use them and the others were self-grading systems
for improving the contractors’ weaknesses regarding BIM. For these reasons, those systems would not be
suitable for owners to use for evaluating contractors’ BIM proficiency during client-contractor interviews.
Thus, a questionnaire that can be used for evaluating contractors during interviews is needed to be
developed for assisting owners in selecting the best contractors. In this research, questionnaire for 81
owners to evaluate contractors’ BIM proficiency were developed based on the requirements for
implementing BIM projects. The usability of this questionnaire was then investigated using a usability
assessment methodology. Interviews with Subject Matter Experts (SMEs) were conducted to obtain further
insight and different perspectives. SMEs participated in this investigation pointed out that: First, the
questionnaire inquired a wide-range of content knowledge in terms of implementing BIM projects;
however, some content required exhaustive knowledge of using BIM, which would be challenging for non-
technical clients. Second, since the questionnaire contains a surplus of questions, it may burden on owners
to read the whole questionnaire. It needs to be scaled down and clearly rearranged. Third, different BIM
projects examined and required different qualifications. The questionnaire would be much more
instrumental and effective if it is developed in certain ways, such as categorizing by project type, size, or
delivery method. Based on the SMEs interviews, it is reasonable to conclude that the questionnaire for
selecting appropriate contractors is feasible and applicable but needs to be developed and updated for easier
usability and efficiency.
REFERENCES

AIA. (2008). “AIA document E202: Building Information Modeling Protocol Exhibit.” (Mar. 15, 2014).

Alarcón, L., and Mourgues, C. (2002). "Performance Modeling for Contractor Selection." Journal of
Management in Engineering, 18(2), 52-60.

Azhar, S. (2011). "Building information modeling (BIM): Trends, benefits, risks, and challenges for the AEC
industry." Leadership and Management in Engineering, 11(3), 241-252.

Conducting in-depth interviews: A guide for designing and conducting in-depth interviews for evaluation
input, Pathfinder International Watertown, MA. CIC Research Group. (2011). BIM project execution
planning guide v2.1." (May. 15, 2013).

CIC Research Group (2012). "Building Information modeling (BIM) planning guide for facility owners."
(Mar. 15, 2013).

City of San Antonio. (2011). "Building Information Modeling (BIM): Development Criteria and Standards
for Design & Construction Projects." (May. 10, 2014).

Creswell, J. W. (2013). Qualitative inquiry and research design: Choosing among five approaches (3rd ed.).
Sage Publications, Thousand Oaks, CA. Department of VA. (2010). The VA BIM Guide. (Mar. 15, 2013).

DiCicco-Bloom, B., and Crabtree, B. F. (2006). "The qualitative research interview." Medical Education,
40(4), 314-321. 84 Dumas, J. S., and Salzman, M. C. (2006). "Usability assessment methods." Reviews of
human factors and ergonomics, 2(1), 109-140. Eastman, C., Teicholz, P., Sacks, F., and Liston, K. (2011).

BIM Handbook: A Guide to Building Information Modeling for Owners, Managers, Designers, Engineers,
and Contractors. wiley, New York. Fong, P. S.-W., and Choi, S. K.-Y. (2000).

Final contractor selection using the analytical hierarchy process." Construction Management &
Economics, 18(5), 547- 557. Georgia Tech. (2011). "Georgia Tech BIM requirements & guidelines for
architects, engineers and contractors." (Jun. 15, 2013).