CORE
Metadata, citation and similar papers at core.ac.uk
Provided by AIS Electronic Library (AISeL)
Fit of Development Methodologies in Software Projects
Fit of Development Methodologies in
Software Projects
Full Paper
Sriram Rajagopalan
Department of Management Studies,
Indian Institute of Technology Madras,
Chennai – 600036, India
[email protected]
Saji K Mathew
Department of Management Studies,
Indian Institute of Technology Madras,
Chennai – 600036, India
[email protected]
Vijayan Sugumaran
School of Business Administration,
Oakland University
Rochester, MI 48309
[email protected]
Abstract
Software project outcomes characterized by meeting goal achievement and performance triad of budget,
schedule and quality have been shown to be contingent upon project environment factors. However, choice
of methodology and its implications on project outcomes still remain under-investigated. Following
contingency theory, we empirically examine the effect of the fit between the choice of development
methodology and project environment on the project outcome. We analysed a sample of 163 software
development projects using PLS-SEM and our results show that the use of traditional methodology strongly
countered the negative effect of requirement volatility on project outcome compared to agile methodologies
and use of hybrid methodologies showed a stronger positive effect of project complexity on goal
achievement. Further, for critical projects, use of agile methodologies favoured goal achievement.
Keywords
Software project outcome, contingency, goal achievement, agile development, traditional methodologies,
methodology choice, requirement volatility, project complexity, project criticality.
Introduction
Although software project management has evolved over several decades to address the challenges caused
by uncertain environment, project challenges continue to prevail (Linberg et al. 1999; Standish Group
2015). A stream of research in project management has identified several factors that influence project
outcome and developed understanding about contingent factors that adversely affect project outcome (Xia
and Lee 2004). Along these lines, some scholars have investigated how levers of project management could
be potentially deployed to manage contingent factors that could impact desired project outcome. Agile and
adaptive methodologies have evolved as projects were becoming more and more complex with uncertain
requirements (Mohammad et al. 2013). However, the mechanism by which project management choices
influence project outcomes is not very clear in the extant literature.
The main aim of our study is to analyse the fit between project environment factors and choice of
methodology and its impact on project outcomes. We statistically analyse a sample of 163 projects from the
Indian software industry to address our research question. We use contingency theory approach, originally
developed for organizational design and later extended to study project organization (Barki et al. 2001).
Twenty-second Americas Conference on Information Systems, San Diego, 2016 1
Fit of Development Methodologies in Software Projects
Our study contributes to software project management literature in three ways. First, ours is one of the first
studies which has empirically examined if the choice of development methodology, especially adaptive
methods, lead to improved project outcome. Second, we develop an understanding of the role of choice of
methodology (agile, hybrid and traditional) as a categorical moderator between project characteristics and
project outcomes. This unique approach of ‘fit as moderation’ (Venkataraman 1989) results in understanding the “fit” between project environment factors and development methodology and how that fit influences
project outcome. Third, our study provides useful insights for project management practice, particularly to
software development community, in decisions pertaining to the choice of development methodology. Prior
studies have reported a lack of scientific approach in the choice methodologies (Ahimbisibwe et al. 2015)
and this study guides managers to look at their projects through factors relevant to their decision context.
Theoretical Background
Research in software projects has approached project management as a tool to align project environment
factors which are volatile with software development process (Barki et al. 2001). Following this approach,
prior research extended the use of contingency theory to software projects, whereby project outcome has
been modeled as contingent on the fit between project characteristics and project management.
Contingency Theory
Information systems research has applied contingency theory in different contexts such as management
information systems success (Venkatraman 1989) and software development (Franz 1985). But the use of
contingency theory was also accompanied by criticisms (Weill and Olson 1989). Following the classification
of Boehm and Turner (2005), we propose to empirically analyse the contingency of software project
outcomes on three important project environment factors: dynamic changes of business scope (volatility),
complexity and criticality and development methodology as project factor
Requirement volatility
Changes in requirements is common in software development due to changes in business needs and priorities of customers and other stakeholders (Verner et al. 2007). They are broadly characterized as change in
scope, new additional requirements and deleting existing requirements which are not within the control of
the project team but are directly or indirectly influenced through external environment. With the advent of
large-scale complex systems, the uncertainty in business user needs and more globalization of development
has caused requirements volatility to increasingly impact software reliability (Damian and Zowghi 2003).
Project Complexity
Project complexity is defined as the sum of all parts which make up a project (Richardson et al. 2001). To
develop complex software systems, the highly preferable approach has been to modularize them (Mccabe
1976). Following agile development principles, Benbya and McKelvey (2006) proposed a co-evolutionary
framework to develop complex adaptive systems including modular design and iterative development.
Project Criticality
Project criticality is defined based on the extent of stakeholder involvement and monitoring from both client
and vendor perspectives (Stock and Tatikonda 2008). Some studies have used contingency approach and
observed that the relationship between stakeholder participation and system use was contingent on top
management support, monitoring, user attitudes, task complexity and participation characteristics of both
vendor and customer (Tait and Vessey 1988). Barki and Hartwick (1989) brought out significant differences
between stakeholder participation and involvement which goes close to the spirit of agile methodologies
where a customer is continually involved in the development, involving and facilitating the change.
Software Development Methodologies
Royce (1970) proposed the sequential process model of analysis, design, development and testing, which is
the fundamental block of waterfall methodologies. Basili and Turner (1975) proposed iterative
Twenty-second Americas Conference on Information Systems, San Diego, 2016 2
Fit of Development Methodologies in Software Projects
enhancement technique for software development, which provided top-down step-wise refinement
approach. Agile methodologies have shown flexibility to address constraints, without demanding major
upfront investments, also being adaptable to changing market conditions (Mohammad et al. 2013).
Petersen and Wohlin (2009) highlighted the limitation of agile methods such as a visible increase in project
efforts, lack of focus on architectural design, lack of scalability, expectation of highly technical expertise,
lack of inter-team communication and dedicated commitment from business stakeholders.
Software Project Outcome
Extant literature in project management has taken two different views of project management outcomeone stream of studies that examine project outcome as success or failure (eg.: DeLone and McLean 2003)
and the other, which deals with project outcome in terms of the three specific project goals (or constraints)
of budget, schedule and scope (eg.: Barki et al. 2001; Lee and Xia 2010). Saarinen (1990) found that
organizations were using methodologies inconsistently following arbitrary approaches resulting in poor
project outcomes. The study strongly suggested that, methodologies should receive adequate coverage in
all phases of the development cycle which was found majorly lacking. Howell et al. (2010) in another recent
study reported that the existence of numerous methodology choices in itself posed difficulty in choosing the
best fit option and so, the developer community opted for the tried and tested methodologies in their
organization and ignored alternatives. However, irrespective of whether a methodology was standardized,
customized or a combination of both were used, if the implementation was limited and not utilized to its
potential, the project efficiency was found to be severely impacted (Joslin and Müller, 2015).
In summary, there have been very limited empirical studies on the contingency effect of project
environment factors and project factors on the project outcomes. Ahimbisibwe et al. (2015) very recently
studied the contingency approach of selection of project management approaches to be adopted to fit
project characteristics and project environment to determine project success. However, their study was
more conceptual at meta-analytic level. Our study addresses this gap by developing an analytical framework
from extant literature and analyses the effect of the relationship between the project environment and
project outcome and how the choice of methodology influences this relationship.
Hypotheses Development
Drawing on contingency theory applied to organizations, we argue that development methodology is a
choice that a project organization uses to align
project contingency factors with project outcomes.
In other words, organizations try to find a fit between
project environment and project context by
exercising its choice on the development methodology. As this study seeks to understand the effect of
the choice of methodology on project outcome, we
hypothesized methodology as a moderator to test the
“fit” between contingency variables and project
management (Venkataraman 1989). Since our focus
is on testing the effect of methodology in addressing
project contingency factors, we choose goal
achievement as a project outcome variable (Linberg
et al. 1999). The research model in Fig. 1 shows the
relationships being studied.
Figure 1. Research Model
Project Environment and Contingency Factors
As our study seeks to understand how development methodology is used as a choice variable to deal with
project contingencies, we selected changes in project scope, project complexity and project criticality as the
key contingency variables that influence project outcome. These are project environment factors contingent
on the nature of the software project being developed.
Twenty-second Americas Conference on Information Systems, San Diego, 2016 3
Fit of Development Methodologies in Software Projects
Prior research has shown that an increase in requirements volatility adversely affects project outcome
impacting the project goal due to residual performance risk (Nidumolu 1996). Scholars suggested the
adoption of agile methodologies to accept and manage changes in customer requirements (Lee and Xia
2010). However, it has been reported that, under conditions of very high requirements volatility, even the
use of agile methodologies would compromise the outcome of functionality achievement (Sharma et.al.
2012). Drawing on the inferences from these studies we hypothesize the following:
H1a: Software project requirements volatility negatively influences goal achievement
H1b: The choice of software development methodologies moderates the relationship between
requirements volatility and goal achievement
Xia and Lee (2004), broadly categorized project complexity along the dimensions of IT and organization
(structural and dynamic). They operationalized project outcome in terms of delivered functionality, cost,
quality and schedule. Their empirical study reported a negative effect of project complexity on project
outcome and suggested measures such as process focus and use of appropriate methodology to reduce the
negative effect. Whitney et al. (2013) showed that, as the complexity increases in terms of modularity and
components being involved, use of appropriate methodology will improve the project outcome. Based on
the findings from previous studies, we hypothesize the following:
H2a: Software project complexity negatively influences goal achievement
H2b: The choice of software development methodology moderates the relationship between project
complexity and goal achievement
Project criticality is related to the importance of the project to client organization and in turn to a vendor
who executes the project. Criticality is characterised by commitment from business users and vendor’s top
management and is usually accompanied by project monitoring by representatives of the client and vendor
organizations (Schmidt et al. 2001). While traditional methods of software development do not stress
stakeholders’ involvement continuously, new methods like agile, iterative development expect dedication
and commitment from customer and vendor to achieve the project goals, either stakeholders aligning to
project criticality and importance (Hajjdiab et al. 2011). Hence, we hypothesize the following relationships:
H3a: Software project criticality positively influences goal achievement
H3b: The choice of software development methodology moderates the relationship between project
criticality and goal achievement
Research Methodology
Data Collection and Measurement
We developed a survey instrument using measures already detailed in existing literature on project
requirements volatility, complexity, criticality and outcome. In order to check the face validity, the survey
instrument was reviewed by 6 experts - 4 IS professionals from the IT industry and 2 senior faculty members
in the IS area and measurement scales were slightly modified. The sample was chosen from IT organizations
across the globe engaged in software development projects. We pursued key informants approach where
the identified respondents were qualified specialists knowledgeable about software development
methodologies, who played a significant role in the process of decision making in choosing the methodology
for software development projects (Kumar et.al., 1993). Selected respondents were requested to choose a
project, which they managed end to end, while responding the questionnaire.
We developed an online version of the survey instrument and the survey link was shared directly through
email to the participants with detailed instructions and the participation in the survey was promoted
through different industry forums All our constructs were identified as reflective from previous literature
(Hair et al. 2014). Table 1 lists the details of the measure development with references.
Construct
Item Description
Requirement RQMV1: level of requirements fluctuation during initial phase
Volatility
(RQMV)
RQMV2: degree of variation in requirements from start to end
Scale
Likert (1-5): 1= Very Low;
5= Very High
1=Never; 5=Very Often
Reference
Nidumolu, 1996;
Verner et al. 2007;
Twenty-second Americas Conference on Information Systems, San Diego, 2016 4
Fit of Development Methodologies in Software Projects
RQMV3: level of requirements fluctuation during testing phase Likert (1-5): 1= Very Low;
5= Very High
RQMV4: How much effort was required to consolidate the
Likert (1-5): 1=Strongly
requirements and bring the users to common understanding as Disagree; 5=Strongly Agree
against the planned effort for requirements
Project
PCXY1: How complex was the project in terms of number of
Likert (1-5): 1= Very Low;
Complexity stated project objectives?
5= Very High
(PCXY)
PCXY2: How complex was the project in terms of number of
Likert (1-5): 1= Very Low;
phases involved?
5= Very High
PCXY3: How complex was the project in terms of number of
Likert (1-5): 1= Very Low;
modules and components developed during the project?
5= Very High
PCXY4: How complex was the project in terms of number of
Likert (1-5): 1= Very Low;
interfaces designed for the project?
5= Very High
Project
PCLY1: Effort spent by client in project monitoring was
Likert (1-5): 1= Very Low;
Criticality
5= Very High
(PCLY)
PCLY2: Importance given to this project in my organization
Likert (1-5): 1= Very Low;
5= Very High
Development COPM: Choice of project methodology
Categorical: 1= Agile; 2=
Methodology
Hybrid; 3= Traditional
(COPM)
Goal
GAMT1: The end outcome of the project met the functional
Likert (1-5): 1=Strongly
Achievement goals defined by the customer
Disagree; 5=Strongly Agree
(GAMT)
GAMT2: The end outcome of the project met the user
Likert (1-5): 1=Strongly
requirements
Disagree; 5=Strongly Agree
GAMT3: The end outcome of the project met the technical
Likert (1-5): 1=Strongly
requirements
Disagree; 5=Strongly Agree
Xia and Lee 2004;
Wallace and Keil
2004
Adapted from
(Verner et al. 2007;
Schmidt et al. 2001)
Boehm and Turner
2005; Ahimbisibwe
et al. 2015
Wallace and Keil
2004; Lee and Xia
2010;
Table 1. Measure Development
Data Analysis Procedure
We received 180 responses to our survey out of which 17 cases were dropped from further analysis due to
incomplete responses or the respondents were not meeting the key informant criteria, resulting in 163
responses for further analysis. The average size of the customer and the service provider organization in
our sample was about 40,000 employees with minimum 1000 and maximum 100,000 employees. The
average size of the customer organization was about 30,000 employees, the size ranging from 1,000
employees to 50,000 employees. The average planned project size was 1370 person months, ranging from
300 to 3000 person months. 43% projects were for customers from US–Canada region and 18% customers
from Europe-UK region. While projects for customers from Asia were 15% and Australia-New Zealand were
5%, 19% of the customer projects were global who had presence in more than one geography. Regarding the
type of the development projects for which the respondents have provided their responses, new
development projects were 32%, reengineering projects constituted 12%, enhancement projects were 10%
and maintenance projects were 8%. Projects under “others” category were combinations of more than 1 of
these project types and covered 38% of the sample size. The projects represented different business
domains and the five top domains which covered 65% of the sample were banking and finance,
manufacturing, retail, healthcare and telecom.
We used Partial Least Squares (PLS) based Structural Equation Modeling (SEM) to test our research model
and used smartPLS software V3.2.3. PLS-SEM estimation is less sensitive to sample size and does not
assume normality of data (Hair et al. 2014). PLS uses a nonparametric bootstrapping method, involving
repeated random samples, replacing from original sample to create a new set of a bootstrap sample. This
bootstrap sample enables to test the significance of the path coefficients estimated (Hair et al. 2014).
Measurement Model
We followed the procedure used by Liang et al. (2007) for the evaluation of our measurement model. We
estimated construct validity through Confirmatory Factor Analysis (CFA) using the measure of the
construct (loadings), other theoretically associated measures (convergent validity) and measures varying
independently (discriminate validity).
Table 2 describes our measurement model and gives the item loadings and Average Variance Extracted
(AVE). We dropped three items which were designed to be part of Requirements Volatility (RQMV), two of
Project Complexity (PCXY) and one of Project Criticality (PCLY), as they had poor validity measure. All
Twenty-second Americas Conference on Information Systems, San Diego, 2016 5
Fit of Development Methodologies in Software Projects
loadings are higher than 0.6 to be accepted as measures of the respective constructs and the values of AVE
is greater than the prescribed minimum value of 0.5 showing that the constructs accounts at least for 50%
of the variance in their respective item measures (Bagozzi and Yi 1988).
Discriminant validity was assessed through two procedures: one, comparing the square root of values of
AVEs of each construct with inter-construct correlations and two, comparing the cross correlations of the
items with their constructs and other constructs (Gefen and Straub 2005). Table 3 displays the interconstruct correlations and the values highlighted in bold across the diagonal represent the square root of
AVE values shared with the measures. All values across the diagonal are sufficiently greater than the desired
value of 0.5 and all these values are greater than the off-diagonal values in their corresponding row and
corresponding column (Fornell et al. 1981). So the two tests affirm the discriminant validity of our
measurement model. Table 2 shows the composite reliability coefficient values for all constructs to be above
0.7, which demonstrates good reliability indicating internal consistency among all the reflective latent
constructs (Hair et al. 2014).
Construct
Indicator
Loadings
Requirements Volatility
(RQMV)
RQMV1
RQMV2
RQMV3
RQMV4
PCXY1
PCXY2
PCXY3
PCXY4
PCLY1
PCLY2
GAMT1
GAMT2
GAMT3
0.715
0.733
0.792
0.684
0.831
0.829
0.706
0.765
0.727
0.849
0.833
0.837
0.727
Project Complexity (PCXY)
Project Criticality (PCLY)
Goal Achievement (GAMT)
Composite
Reliability
0.822
Average Variance
Extracted (AVE)
0.544
0.864
0.616
0.768
0.625
0.842
0.642
Table 2. Reliability and Convergent Validity of the Measurement Model
Requirements Volatility (RQMV)
Project Complexity (PCXY)
Project Criticality (PCLY)
Goal Achievement (GAMT)
RQMV
0.732
0.329
0.250
-0.122
PCXY
PCLY
GAMT
0.785
0.456
0.258
0.791
0.254
0.801
Table 3. Discriminant Validity: Inter-correlations between Reflective Constructs
Common Method Bias
Two approaches were adopted to test common method bias in our model. First, we employed Harman
single-factor test for all items of constructs (Podsakoff et al. 2003). The test showed four distinct factors
(Eigenvalues > 1.0) and the largest of the factor accounted only for 24.9% of the variance of the model. To
strengthen this result, we further used unmeasured latent method factor (Podsakoff et al. 2003). It was
found that the average substantively explained variance of the indicators is significantly higher than the
average method based variance. Also, all the method factor loadings were not significant (p < 0.05).
Therefore, we rule out common method variance in our measurement based on the two tests.
Structural Model
We followed two approaches for testing the proposed structural model covering the hypothesised
relationships among the project environment factors and the criterion variables. (i) Using all the constructs
in one iteration and testing the direct effects of the exogenous constructs on the endogenous constructs. (ii)
Testing the moderating effects of choice of methodology on the same relationships using PLS multi-group
analysis. The results of full structural model estimation are presented in Table 4.
For the first approach, we used PLS-SEM conducting a sequence of regressions in terms of weight vectors.
We analysed the signs and magnitude of the relationship of each exogenous construct with an endogenous
construct for the original sample (n=163). To further determine the significance of the estimates, we used
Twenty-second Americas Conference on Information Systems, San Diego, 2016 6
Fit of Development Methodologies in Software Projects
bootstrapping method (Henseler et al. 2009) with n1=3000 bootstrapped data. Comparing the path
coefficients value determined through normal PLS-SEM without and with bootstrapping, we found that
signs were consistent and observed no major difference in the magnitude of path coefficients. The model
explained 18% variance for goal achievement.
Structural model’s results in Table 4 further show that the requirements volatility had a significant negative
effect on the goal achievement (β= -0.276; p<0.05) and the project criticality had a significant positive
effect (β=0.204; p<0.05) on the goal achievement supporting our hypotheses H1a and H3a respectively.
However, at the same significance level, the project complexity is observed to have a significant positive
effect on the goal achievement, in contrast to our hypothesis (β=0.284; p<0.05). So, although the
relationship was significant, H2a was not accepted.
Moderating Effects Hypotheses Testing
Direct Effects – Goal Achievement
Original
Mean boot β (std error)
R2
Comments
β
(n1=3000)
(n1= 3000)
(n=163)
Requirements Volatility (RQMV) -0.260
-0.276 (0.095) *
0.02
H1a supported
Project Complexity (PCXY)
0.268
0.284 (0.087) *
0.08
H2a not accepted
Project Criticality (PCLY)
0.204
0.204 (0.087) *
0.08
H3a supported
Moderation Effects of Choice of Methodology- Goal Achievement
Variables
Path Coefficients
Comments
Mean Boot β (n=3000)
Agile
Hybrid
Traditional
(n1=30)
(n2=69)
(n3=64)
Requirements Volatility (RQMV) -0.526
-0.039
-0.319*
H1b partially supported
Project Complexity (PCXY)
0.075
0.499*
0.220
H2b partially supported
Project Criticality (PCLY)
0.681*
-0.010
0.087
H3b partially supported
Variables
Table 4. Structural Model
To test the moderation effect of choice of methodology on the various relationships, we used PLS MultiGroup Analysis (PLS-MGA) technique. The choice of methodology variable in our study is designed to be a
categorical measure having three discrete values and in such cases, the test for pure moderator effect can
be performed using a multi-group specification of the structural equation model (Sauer and Dick 1993).
The results of the PLS-MGA using choice of methodology as moderator variable are also given in Table 4.
Our results show that using traditional methodologies in projects led to a stronger and significant negative
effect of requirements volatility on goal achievement (β=-0.319; p<0.05) compared to the effect based on
the whole sample (β=-0.276; p<0.05). But the effect was not significant while using agile and hybrid
methodologies. So the hypotheses H1b was partially supported. Furthermore, using hybrid methodologies
led to stronger and significant positive effect of project complexity on goal achievement (β=0.499; p<0.05),
as compared to the effect based on whole sample (β=0.284; p<0.05). However, the results were not
significant either for agile or for traditional methodologies. So the hypotheses H2b was only partially
supported. Using agile methodologies in projects led to a stronger positive effect of project criticality on
goal achievement (β=0.681; p<0.05) compared to the effects of the whole sample (β=0.204; p<0.05). But,
the choice of traditional and hybrid methodologies did not have a significant moderating effect on the
relationship of project criticality on goal achievement. So the hypotheses H3b was partially supported.
Discussion and Implications
Our research followed contingency theory based approach to determine how the choice of methodologies
influences the relationship of project characteristics and project outcomes in terms of goal achievement.
Our findings on the negative effects of requirements volatility on goal achievement is consistent with
earlier studies (Wallace and Keil 2004). However, the moderating effects of choice of methodologies on the
relationship between requirements volatility on goal achievement did not favor agile methodologies,
contradicting the propositions from some prior studies (e.g.: Mohammad et al. 2013).
Twenty-second Americas Conference on Information Systems, San Diego, 2016 7
Fit of Development Methodologies in Software Projects
The comparatively weaker negative effect of requirements volatility on project outcomes when using
traditional methodology may be due to few reasons. Because of frequent change in requirements and
changes in priorities, there is often deviation from original scope and very high variability between
originally planned goals and goals achieved (Sharma et al. 2012). Further, while using traditional
methodologies the decision making lies with project manager whereas in agile methodologies decision
making is driven by highly empowered cohesive teams. Many times, individuals in teams privately agree on
the means of resolving an issue but not shared with the group due to Abilene Paradox symptom (Harvey
1974). So, this leads to lack of consensus and cohesion (McAvoy and Butler 2009).
While using agile, when requirement volatility is very high, there is a possibility of resource wastage thereby
cost could escalate due to continual rework (Sharma et al. 2012). For large systems, the amount of interdependencies and integration requirements are high; if not well-defined upfront, may lead to development
of a system different from what was envisaged originally (Turk et al. 2005). In large hierarchical
organizations, for effective requirements management, it is suggested to follow traditional approach at the
global level and agile approach at the local level thereby fostering mixed approach (Kumar & Kumar 2011).
It is also interesting to note the positive effect of project complexity on goal achievement contradicting
some findings from prior literature (Xia and Lee 2004). This is in alignment to the process maturity in large
organizations developing complex systems, which can also be observed through our survey responses. The
average size of vendor organization was 40,000 and in response to the question about adhering to process
practices consistently across all stages of projects, 75% of respondents have concurred. The moderating
effect of choice of methodology on the relationship between project complexity and goal achievement was
not found to be significant either for agile or for traditional methodologies while it was significantly positive
for hybrid methodologies. This is consistent with the practice that, for large mission-critical complex
projects it is highly preferable to be moderate in the approach and follow hybrid methodologies during every
phase of the development (Turk et al. 2005).
The significant and positive direct effects of project criticality on goal achievement were found to be
resonating with the study of prior researchers (Soderberg et al. 2013). It appears that when the project is
highly critical, the tendency of the stakeholders is to prioritize completing the project (delivering the defined
scope) primarily at the expense of other factors. Also, our results show significant and positive moderating
effects of agile methodologies on the relationship between project criticality and goal achievement, in
agreement with prior studies (Hajjdiab et al. 2011). This implies that while using agile methodologies,
monitoring and involvement is high from stakeholder which positively influences to meet the desired goals.
Limitations and Future Research
Although our study produced interesting results useful for theory and management practice, the study has
some limitations. Our sample size was small as, often the project managers approached were constrained
by the non-disclosure agreement with their organization and customers. To overcome the limitations due
to this, we chose PLS path modelling and bootstrapping procedure for significance testing which produced
moderately stable results.
Our study included only the relationship of project environment and project outcome but there are other
constructs which could significantly influence project outcome as highlighted in earlier studies such as team
turnover, team experience (Gopal et al. 2003), team response extensiveness and team response efficiency
(Lee and Xia 2010). Our future work aims to empirically analyse how these team related variables influence
project outcomes based on the choice of methodologies. Our study was conducted at a high-level
classification of methodology and we analysed them as traditional, agile and hybrid. However, it would be
insightful to further investigate the moderating effects of specific types of agile methodologies like Scrum
and XP, and specific types of traditional methodologies like waterfall and spiral.
References
Ahimbisibwe, A., Cavana, R. Y., and Daellenbach, U. 2015. “A contingency fit model of critical success
factors for software development projects: A comparison of agile and traditional plan-based
methodologies,” Journal of Enterprise Information Management (28:1), pp. 7-33.
Twenty-second Americas Conference on Information Systems, San Diego, 2016 8
Fit of Development Methodologies in Software Projects
Bagozzi, R. P., and Yi, Y. 1988. “On the evaluation of structural equation models,” Journal of the academy
of marketing science (16:1), pp. 74-94.
Barki, H., and Hartwick, J. 1989. “Rethinking the concept of user involvement,” MISQ (13:1), pp. 53-63.
Barki, H., and Suzanne Rivard, J. T. 2001. “An integrative contingency model of software project risk
management,” Journal of Management Information Systems (17:4), pp. 37-69.
Basili, V. R., and Turner, A. J. 1975. “Iterative enhancement: A practical technique for software
development,” IEEE Transactions on Software Engineering (4), pp. 390-396.
Benbya, H., and McKelvey, B. 2006. “Toward a complexity theory of information systems
development,” Information Technology & People (19:1), pp. 12-34.
Boehm, B., and Turner, R. 2005. “Management challenges to implementing agile processes in traditional
development organizations,” IEEE Software (22:5), pp. 30-39.
Damian, D. E., and Zowghi, D. 2003. “RE challenges in multi-site software development
organisations,” Requirements engineering (8:3), pp. 149-160.
DeLone, W. H., and McLean, E. R. 2003. “The DeLone and McLean model of information systems success:
a ten-year update,” Journal of management information systems (19:4), pp. 9-30.
Fornell, C. G., and Larcker, D. F. 1981. “Evaluating structural equation models with unobservable variables
and measurement error,” Journal of Marketing Research (18:1), pp. 39–50.
Franz, C. R. 1985. “User Leadership in the Systems Development Life Cycle: A Contingency Model,” Journal
of Management Information Systems (2:2), pp. 5-25.
Gefen, D., and Straub, D. 2005. “A practical guide to factorial validity using PLS-Graph: Tutorial and
annotated example,” Communications of the Association for Information systems (16:1), pp. 91-109.
Hair, J. F., Hult, G. T. M., Ringle, C., and Sarstedt, M. 2014. A primer on partial least squares structural
equation modeling (PLS-SEM), Sage Publications. USA.
Hajjdiab, H., and Taleb, A. S. 2011. “Adopting agile software development: Issues and challenges,”
International Journal of Managing Value and Supply Chains (2:3), pp. 1-10.
Harvey, J. 1974. “The Abilene paradox: the management of agreement,” Organizational Dynamics (3:1),
pp. 63–80.
Henseler, J., Ringle, C. M. and Sinkovics, R. R. 2009. “The use of partial least squares path modeling in
international marketing,” Advances in International Marketing (20:1), pp. 277-320.
Howell, D., Windahl, C., and Seidel, R. 2010. “A project contingency framework based on uncertainty and
its consequences,” International Journal of Project Management (28:3), pp. 256-264.
Joslin, R., and Müller, R. 2015. “Relationships between a project management methodology and project
success in different project governance contexts,” International Journal of Project Management (33:6),
pp. 1377-1392.
Kumar, S. A. and Kumar, T. A. 2011. “Study the Impact of Requirements Management Characteristics in
Global Software Development Project: An Ontology Based Approach,” International Journal of Software
Engineering and Application (2:4), pp. 107.
Kumar, N., Stern, L. W., and Anderson, J. C. 1993. “Conducting interorganizational research using key
informants,” Academy of management journal (36:6), pp. 1633-1651.
Lee, G., and Xia, W. 2010. “Toward agile: an integrated analysis of quantitative and qualitative field data,”
MISQ (34:1), pp. 87-114.
Liang, H., Saraf, N., Hu, Q., and Xue, Y. 2007. “Assimilation of enterprise systems: the effect of institutional
pressures and the mediating role of top management,” MIS quarterly (31:1), pp. 59-87.
Linberg, K. R. 1999. “Software developer perceptions about software project failure: a case study,” Journal
of Systems and Software (49:2), pp. 177-192.
Twenty-second Americas Conference on Information Systems, San Diego, 2016 9
Fit of Development Methodologies in Software Projects
McAvoy, J. and Butler, T. 2009. “The role of project management in ineffective decision making within
Agile software development projects,” European Journal of Information Systems (18:4), pp. 372-383.
McCabe, T. J. 1976. “A complexity measure,” IEEE Trans on Software Engineering (4), pp. 308-320.
Mohammad, A.H., Alwada, T., and Ababneh, J.M.A. 2013. “Agile software methodologies: strength and
weakness,” International Journal of Engineering Science and Technology (5:3), pp. 455–459.
Nidumolu, S. R. 1996. “Standardization, requirements
performance,” Information & Management (31:3), pp. 135-150.
uncertainty
and
software
project
Petersen, K., and Wohlin, C. 2009. “A comparison of issues and advantages in agile and incremental
development between state of the art and an industrial case,” Jl of Sys & software (82:9), pp. 1479-1490.
Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., and Podsakoff, N. P. 2003. “Common method biases in
behavioral research: a critical review of the literature and recommended remedies,” Journal of applied
psychology (88:5), pp. 879-903.
Richardson, K. A., Cilliers, P., and Lissack, M. 2001. “Complexity Science,” Emergence (3:2), 6-18.
Royce, W. W. 1970. “Managing the development of large software systems,” in Proceedings of IEEE
WESCON (26:8), pp. 1-9.
Saarinen, T. 1990. “System development methodology and project success: An assessment of situational
approaches,” Information & Management (19:3), pp. 183-193.
Sauer, P. L., and Dick, A. 1993. “Using moderator variables in structural equation models,” Advances in
consumer research (20:1), pp. 637-640.
Schmidt, R., Lyytinen, K., and MarkKeil, P. C. 2001. “Identifying software project risks: An international
Delphi study,” Journal of management information systems (17:4), pp. 5-36.
Sharma, S., Sarkar, D., and Gupta, D. 2012. “Agile processes and methodologies: A conceptual
study,” International journal on computer science and Engineering (4:5), pp. 892-898.
Standish Group., 2015. “Chaos Report,” The Standish Group International Inc.
Stock, G. N., and Tatikonda, M. V. 2008. “The joint influence of technology uncertainty and
interorganizational interaction on external technology integration success,” Journal of operations
management (26:1), pp. 65-80.
Tait, P., and Vessey, I. 1988. “The effect of user involvement on system success: a contingency
approach,” MIS quarterly (12:1), pp. 91-108.
Turk, D., France, R., and Rumpe, B. 2005. “Assumptions underlying agile software development processes,”
Journal of Database Management (16:4), pp. 62-87.
Venkatraman, N. 1989. “The concept of fit in strategy research: Toward verbal and statistical
correspondence,” Academy of management review (14:3), pp. 423-444.
Verner, J., Cox, K., Bleistein, S., and Cerpa, N. 2007. “Requirements engineering and software project
success: an industrial survey in Australia and the US,” Australasian Journal of Information
Systems, (13:1), pp. 225–238.
Wallace, L., and Keil, M. 2004. “Software project risks and their effect on outcomes,” Communications of
the ACM (47:4), pp. 68-73.
Weill, P., and Olson, M.H. 1989. “An Assessment of the Contingency Theory of Management Information
Systems,” Journal of Management Information Systems (6:1), pp. 59-85.
Whitney, K. M., and Daniels, C. B. 2013. “The Root Cause of Failure in Complex IT Projects: Complexity
Itself,” Procedia Computer Science (20), pp. 325-330.
Xia, W., and Lee, G. 2004. “Grasping the complexity of IS development projects,” Communications of the
ACM (47:5), pp. 68-74.
Twenty-second Americas Conference on Information Systems, San Diego, 2016 10