2000 Information Management
2000 Information Management
2000 Information Management
Abstract
This paper explores the relevance of research on implementation and user acceptance given the pervasiveness of technology
in modern organizations. The paper presents the results of applying an extended model of technology acceptance to the use of
broker workstations. We argue that implementation success is important in obtaining a return from the rm's investment in
technology. Data are collected at two points in time to assess user acceptance of the workstations. The results provide some
support for the models and the unanticipated nding that perceptions of system quality and system ease of use decreased over
time. The paper suggests that a combination of research methodologies may be appropriate for assessing user acceptance of
the complex technology typically found in today's rms. # 2000 Elsevier Science B.V. All rights reserved.
Keywords: Implementation; Technology acceptance model; Workstations; Task-technology t
1. Introduction
The pace of change and user adoption increases
with each technological innovation. It took 5 years for
personal computers to become a major factor in
business. Once the Internet could be used for prot,
the number of service providers and users grew exponentially. With such rapid change and widespread
adoption, does the organization need to be concerned
with acceptance and implementation issues that have
characterized earlier technology innovations? Are
users nally ready to adopt technology without some
of the implementation problems witnessed in the
past?
This paper addresses two questions: (1) is implementation research relevant in today's high-technology business environment; and (2) how well do
$
0378-7206/00/$ see front matter # 2000 Elsevier Science B.V. All rights reserved.
PII: S 0 3 7 8 - 7 2 0 6 ( 0 0 ) 0 0 0 5 9 - 8
120
Early research on implementation can be characterized as empirically-driven. Factor researchers proposed descriptive models of implementation,
including variables other researchers had found to
be related to success, and usually adding new variables
1
Comments by Hugh McColl, NationsBank's chairman at an
NYU CEO Forum, 4 July 1997.
121
122
123
3. The study
We collected data in the fall of 1993 and again in the
fall of 1995 to test the model in Fig. 1 from the
institutional brokerage group of a major stock brokerage rm. The 1993 data (time 1) was collected within
6 months of the installation of a new workstation for
all brokers in the group. The workstation provided a
number of functions including the ability to obtain
stock quotations, to communicate via e-mail, and to
analyze securities data. We developed a survey instrument based on past research, and three research assistants administered the survey in a 2030 minute phone
interview. A total of 41 out of 59 brokers in four
locations completed the interviews. Two years later
(time 2) we again collected data from the brokers who
had responded at time 1. We were surprised to nd that
only 25 brokers from the original 41 remained in their
same position at the time 2 survey; this is a high
mortality rate, particularly for a job described as being
very attractive with low turnover.
3.1. Data and variables
Table 1 provides the denition of the data included
in the study. We used scales from past research or new
scales which we developed after interviewing brokerage rm managers and brokers. Because brokers' time
is very valuable, the length of the phone call was
limited. Therefore, we dropped some items from past
scales in order to t interview time constraints. The
individual items in the scales may be found in the
Appendix A.
The four strategy variables came from these interviews and are single-item questions. There was virtually no correlation among the strategies and we
consider them to be independent of each other.
The system quality scale of ve items is based on a
number of past studies [12]. The reliability of these
scales is in the 0.60.75 range, which is somewhat
lower than the scale reliabilities in similar studies in
the past.
Perceived usefulness and ease of use have been
adapted from Davis' scales used in his studies of TAM
[3]. We developed an instrument to measure social
norms based on Ref. [5] and pretested it on a group of
MBA students. Based on these results, we constructed
the individual items for social norms shown in the
124
Table 1
Description of variables in the study
Variable name
Description
Number
responses
a-reliability
Mean
Standard
deviation
STGMEET
STGMTCH
STGPORT
STGRES
SYSQUAL
PERUSE
PEREOU
NORMS
41
41
41
41
39
41
41
39
na
na
na
na
0.63
0.69
0.63
0.82
4.44
4.90
4.12
3.85
3.71
4.44
3.92
3.81
0.92
0.30
0.90
0.94
0.62
0.60
0.60
0.79
38
41
41
41
0.75
0.73
na
na
2.91
4.50
17373
29519
0.98
0.58
23809
22645
INTENT
USAGE
SALES92
SALES93
a
3:42
F 11:72 n 39
Stepwise
R2 0:22
p 0:10; p 0:05;
p 0:01
(1)
0:34 SYSQUAL
PEREOU 0:36 STGMEET
2:48
R 0:25 F 7:30
Stepwise
2:35
n 39
(2)
125
Eq. (3) predicts usage for the original TAM. Here only
perceived usefulness is significant, and the two variables explain 15% of the variance in usage. The
relationships posited in TAM are supported by the
data, but the results are weak.
0:21 PEREOU
USAGETAM 0:31 PEURSE
1:34
2:01
R 0:15 F 4:50
n 39
14:12
(3)
1:32
1:92
R 0:20 F 3:34
n 39
(4)
Eqs. (5) and (6) repeat the analysis above for intentions to use the system rather than self-reported usage.
In Eq. (5) for the original TAM, we see the same
pattern as Eq. (3); perceived usefulness is significant
and both perceptions are positively related to Intent.
The amount of variance explained is only 7%, which
means the model does not shed much light on intentions.
0:07 PEREOU
INTENTTAM 0:31 PERUSE
0:43
1:83
R 0:07 F 2:34 n 38
(5)
0:37
R2 1:5 F 2:58 n 36
0:31
(6)
R 0:86 F 124:66
n 41
2:60
(7)
126
Table 2
Time 2 vs. Time 1
Variable
name
Description
t2
Time 1
mean
Time 2
mean
Difference
Matched
t-statistic
SYSQUAL
STGMEET
STGMTCH
STGPORT
STGRES
PERUSE
PEREOU
NORMS
24
25
25
25
25
25
25
24
0.75
na
na
na
na
0.68
0.42a
0.75
3.6
4.4
4.9
4.0
3.9
4.4
3.9
3.8
3.3
4.4
4.8
4.1
3.8
4.4
3.5b
3.7
0.3
0
0.1
0.1
0.1
0
0.4
0.1
2.30**
0
1.44
0.57
0.57
0
3.36**
0.94
25
0.85
4.5
4.4
0.1
0.77
USAGE
a
The decrease in reliability from t1 (0.63) to t2 (0.42), for PEREOU is troubling. While some of the decrease might be attributed to a
smaller sample size at time 2, reliabilites for other variables at time 2 did not show similar declines. The standard deviation for PEREOU is
very similar for time 1 vs. time 2. The Pearson correlation for PEREOU at time 1 with PEREOU at time 2 is 0.63 which is a measure of test
retest reliability. This number is comparable to other time 12 correlations for individual variables. When we examined the items in the scale,
we found that by eliminating `received sufficient training' the a rose to 0.7. Please see the discussion of time 2 results in the text for further
information.
b
Using the more reliable version of this scale, eliminating the item `received sufficient training', results in a time 2 mean of 3.6, a
difference of 0.3 and a t-value of 2.51**. PEREOU and SYSQUAL still remain the only two variables which are significantly different
between time 1 and time 2, and both of them are less favorable in 1995 than 1993.
127
deal to our understanding of acceptance. The implementation and acceptance of information technology
is and will remain a key determinant of the return the
organization receives from its IT investments, and
models of acceptance and implementation should lead
to more successful IT initiatives.
Appendix A. Survey items
All responses are 15, strongly agree to strongly
disagree.
STGMEET The successful broker has to spend considerable time meeting with clients
STGMTCH The successful broker finds stocks and
opportunities that match the client's
strategy
STGPORT The successful broker functions as an
unpaid portfolio manager
STGRES
The successful broker spends significant
time each day doing research for clients
SYSQUAL It is very easy to retrieve and organize
data using the workstation
The workstation's response time is very
fast
The workstation's data is very accurate
(the data are correct)
The workstation is very reliable (does
not go down)
Using the workstation is much better
than using the previous [system's name]
PERUSE
Using the workstation improves my
performance
Using the workstation enhances my
effectiveness
PEREOU
I find the workstation easy to use
I have received sufficient training to use
the workstation effectively
I find it easy to get the workstation to do
what I want it to do
NORMS
Other institutional brokers whom I
respect strongly support my using the
Institutional Broker Workstation
My immediate manager strongly supports my using the workstation
[Firm's name] senior management
strongly supports my using the workstation
128
INTENT
USAGE
[14]
[15]
[16]
[17]
[18]
[19]
[20]
References
[1] S. Barley, The alignment of technology and structure through
roles and networks, Administrative Science Quarterly 35 (1),
1990, pp. 61103.
[2] R. Cooper, R. Zmud, Information technology implementation
research: a technological diffusion approach, Management
Science 36 (2), 1990, pp. 123139.
[3] F. Davis, Perceived usefulness, perceived ease of use, and
user acceptance of information technology, MIS Quarterly 13
(3), 1989, pp. 319340.
[4] F. Davis, R. Bagozzi, P. Warshaw, User acceptance of
computer technology: a comparison of two theoretical
models, Management Science 35 (8), 1989, pp. 9821003.
[5] M. Fishbein, I. Ajzen, Belief, Attitude, Intention and
Behavior: An Introduction to Theory and Research, Addison-Wesley, Reading, MA, 1975.
[6] M. Fishbein, I. Ajzen, Understanding Attitude and Predicting
Social Behavior, Prentice-Hall, Englewod Cliffs, NJ, 1980.
[7] D. Goodhue, Understanding user evaluations of information
systems, Management Science 41 (12), 1995, pp. 18271844.
[8] J. Hartwick, H. Barki, Explaining the role of user participation in information system use, Management Science 40 (4),
1994, pp. 440465.
[9] J. Howell, C. Higgins, Champions of technological innovations,
Administrative Science Quarterly 35 (2), 1990, pp. 317341.
[10] H. Lucas, Why Information Systems Fail, Columbia University Press, New York, 1975.
[11] H.C. Lucas, Jr., The implementation of an Operations
Research Model in the Brokerage Industry, TIMS Studies in
the Management Sciences, No. 13 (1979), pp. 139154.
[12] H. Lucas, Jr., R. Schultz, M. Ginzberg, Information Systems
Implementation: Testing a Structural Model, Ablex, 1990.
[13] H. Lucas, V. Spitler, Technology use and performance: a field
[21]