Ijerph 15 01972
Ijerph 15 01972
Ijerph 15 01972
Environmental Research
and Public Health
Article
Understanding the Role of Mobile Internet-Based
Health Services on Patient Satisfaction
and Word-of-Mouth
Dongxiao Gu 1,2,† , Xuejie Yang 1 , Xingguo Li 1,† , Hemant K. Jain 3,† and Changyong Liang 1, *
1 The School of Management, Hefei University of Technology, Hefei 230009, China;
[email protected] (D.G.); [email protected] (X.Y.); [email protected] (X.L.)
2 The School of Informatics, Computing and Engineering, Bloomington, IN 47405-3907, USA
3 College of Business, The University of Tennessee at Chattanooga, 615 McCallie Ave, Chattanooga, TN 37403,
USA; [email protected]
* Correspondence: [email protected]; Tel.: +86-181-2391-7616
† These authors contributed equally.
Received: 30 July 2018; Accepted: 3 September 2018; Published: 10 September 2018
Abstract: With the rapid advancement of Web 2.0 technologies, Internet medicine, and mobile
healthcare, the influence of the use of patient-oriented Mobile Internet-based Health Services
(MIHS) on patient satisfaction and the electronic word-of-mouth (WOM) of health service agencies
is becoming the focus of the academic research community. Many large hospitals, including
some Internet hospitals, have provided various online healthcare service platforms that enable
patients to expediently consult with physicians and obtain healthcare services in an online to offline
format. The purpose of this study is to analyze the main mechanisms of how the features and
users’ experiences of MIHS influenced patient satisfaction and continuous use behaviors of the
system to generate additional WOM dissemination behaviors. Based on post-adoption behavior
and Expectation Confirmation Model of Information Technology Continuance (ECM-IT), this study
conducted an empirical study through data collection from users (patients) from a large hospital
providing online healthcare services. A total of 494 pieces of data were collected and analyzed using
SmartPLS2.0(SmartPLS GmbH, Hamburg, Gernmany). The results show that: (1) patient satisfaction
with MIHS and their intentions to continue use of MIHS have significantly positive influences on
WOM; (2) patient satisfaction with MIHS is positively influenced by perceived usefulness and
confirmation of MIHS performance expectations; (3) and patient intentions to continue use of
MIHS are also affected by some technology factors, such as facilitating conditions and perceived
risk, as well as some subjective feelings, such as perceived usefulness and perceived interactivity.
The results of this study provide important implications for both research and practice of public health.
Keywords: patient satisfaction; mobile Internet-based health service; expectation confirmation model;
patient participation; Internet medicine; patient word-of-mouth
1. Introduction
Health care is one type of service, which involves intangibility, heterogeneity and deep customer
participation. With the advancement of Web 2.0 technologies, the traditional method of understanding
disease and treatment has been changed, and an increasing number of public sector big hospitals
are providing online healthcare service by using an online healthcare platform. Among these kinds
of platforms, there are also a healthcare service and communication community in which patients
can easily find preferred doctors and make appointments for diagnosis and treatment. For patients,
finding a doctor through an online healthcare platform has significantly changed from the traditional
Int. J. Environ. Res. Public Health 2018, 15, 1972; doi:10.3390/ijerph15091972 www.mdpi.com/journal/ijerph
Int. J. Environ. Res. Public Health 2018, 15, 1972 2 of 23
post-satisfaction behavior, such as continued use of services. For example, previous studies showed
that a Hospital Information System (HIS) can promote patient satisfaction by improving doctors’ work
efficiency, reducing waiting times, and offering patients convenient services and useful information [15].
Close relationships are also proven to exist in information technology along with the use behavior and
outcomes [16,17]. Among these studies, various studies did not examine the patient post-satisfaction
behavior. Additionally, the factors affecting patient WOM behaviors are diverse and complex,
which likely include technical factors as well as social, economic, cultural and psychological factors.
Moreover, MIHS has more convenient and interactive functions compared to traditional health service
platforms. Few studies examine the role of MIHS on patient WOM. Thus, it is extremely important
to explore factors affecting patient WOM and post-adoption behaviors in the context of Internet
medicine, social networking, and interactive technology applications. To fill this gap, the current study
draws upon the theory of post-adoption behavior and Expectation Confirmation Model of Information
Technology Continuance (ECM-IT) to discuss the role of online health services on patient WOM to
health service agencies.
On the basis of our related literature review, this research could be considered as first empirical
study to examine MIHS’s role in promoting patient satisfaction, the continued use of MIHS and WOM.
This study investigates the connections of factors for patient satisfaction, continued use and WOM.
Therefore, this research work will be helpful for hospital management, offering a better understanding
about the role of online healthcare service platforms to improve patient satisfaction and hospitals’
reputation. Moreover, it can also provide guidance for researchers and practitioners who design and
develop these types of systems to support convenient and interactive online heath care services.
The rest of the paper is organized as follows: in Section 2, based on reviewing relevant theories
and research, we develop a research model and propose hypotheses. Section 3 discusses the research
methodology used to validate our proposed hypotheses. Section 4 presents the results. Finally, this
paper concludes with a discussion of findings, implications for theory, practice and opportunities for
future research in Section 5.
Facilitating Conditions
H9-11
Intention to
continued use of
Perceived Risk
MIHS
Perceived Interactivity
H1-2 Electronic
word-of-
H8 H3
Mouth(W
H6-7
OM)
Perceived Usefulness
H5
Patient
Confirmation of MIHS Satisfaction with
Performance MIHS
H4
Expectation
Figure 1.
Figure Research Model.
1. Research Model.
Hypothesis 2 (H2). A patient continued intention to use MIHS has a significantly positive effect on WOM
towards MIHS.
Hypothesis 3 (H3). A patient satisfaction with MIHS has a significantly positive effect on the continued
intention to use MIHS.
Hypothesis 4 (H4). A patient confirmation of MIHS performance expectations has a significantly positive
effect on his or her satisfaction with MIHS.
Hypothesis 5 (H5). A patient confirmation of MIHS performance expectations has a significantly positive
effect on his or her perceived usefulness of MIHS.
Hypothesis 6 (H6). A patient perceived usefulness of MIHS has a significantly positive effect on his or her
satisfaction with MIHS.
Int. J. Environ. Res. Public Health 2018, 15, 1972 6 of 23
Hypothesis 7 (H7). A patient perceived usefulness of MIHS has a significantly positive effect on his or her
intention to continued use of MIHS.
Hypothesis 8 (H8). Perceived interactivity has a significantly positive effect on the perceived usefulness
of MIHS.
Hypothesis 9 (H9). Perceived interactivity has a significantly positive effect on the continued use intention
of MIHS.
Int. J. Environ. Res. Public Health 2018, 15, 1972 7 of 23
Hypothesis 10 (H10). Perceived risk has a significantly negative effect on the continued use of MIHS.
Hypothesis 11 (H11). Facilitating conditions have a significantly positive effect on the continued use intention
of MIHS.
3. Research Methodology
(a) Patients can access MIHS via the Internet or the hospital’s WeChat public account.
Doctors’ information and their schedules are also available in the system, and patients can search,
choose, and make appointments with their preferred doctors. They can complete registration,
prepay online instead of waiting in line, and cancel appointments.
(b) The hospital can conduct post-operation health tracking and evaluation for a patient. The medical
staff can obtain feedback from patients and offer medical and health-related suggestions,
if necessary. Patients can communicate their symptoms to the doctors or nurses directly.
They can discuss their current health status, postoperative rehabilitation, relevant precautions,
etc. Additionally, the doctors can also provide online remote diagnosis services to patients with
chronic diseases.
(c) Patients can assess their own health status based on a case-based health self-assessment subsystem.
The type of assessment is based on historical cases and the whole life-cycle dynamic health data
of the patients. Generally, only health status (level), but sometimes potential health risks and
health promotion solutions can also be obtained. Patients can also consult with doctors about the
assessment results and ask for suggestions.
(d) Patients can acquire various health care and expense information. Health care information
includes electronic health records, physical examination reports, etc. Expense information
includes registration fees, detailed operation fees, drug fees, etc. Digital health care reports can
be printed out by patients via a procedure of application and verification. This allows patients
to easily track care processing and outcomes. Patients can voice concerns about their treatment,
the nursing process, and expenses.
(e) Patients can also perform medical care service satisfaction evaluations on doctors, nurses,
departments, teams, the hospital, or a specific medical service event, such as an operation.
They can leave detailed information about why and in what areas they are satisfied. The hospitals
can conduct a satisfaction analysis based on the collected assessment data, which will be helpful
for the promotion of its health care service.
Int. J. Environ. Res. Public Health 2018, 15, 1972 9 of 23
Int. J. Environ. Res. Public Health 2018, 15, x FOR PEER REVIEW 9 of 23
…
…
• Prepaid
Cyber patient- • Bank transfer to your healthcare card
oriented payment • Payment & Receipts
service (a) • Questions or suggestions on payment
•…
Figure
Figure 2. The
2. The main
main features
features of MIHS.
of MIHS.
3.2. Measures
3.2. Measures
Measures for all concerned variables were taken from previous studies and adapted to the context
Measures for all concerned variables were taken from previous studies and adapted to the
of healthcare. Eight variables were measured in this study: Confirmation of MIHS performance
context of healthcare. Eight variables were measured in this study: Confirmation of MIHS
expectations, Perceived Usefulness (PU), Perceived Interactivity (PI), Facilitating Condition (FC),
performance expectations, Perceived Usefulness (PU), Perceived Interactivity (PI), Facilitating
Perceived Risk (PR), Patient satisfaction with MIHS, Intention to continually use MIHS, and Electronic
Condition (FC), Perceived Risk (PR), Patient satisfaction with MIHS, Intention to continually use
Word of Mouth (WOM). The questionnaires were formed by using Likert scales ranging from 1
MIHS, and Electronic Word of Mouth (WOM). The questionnaires were formed by using Likert scales
(strongly disagree) to 7 (strongly agree), which requires respondents to select a number from the scale.
ranging from 1 (strongly disagree) to 7 (strongly agree), which requires respondents to select a
In Table 1, the measurement items and their sources are listed.
number from the scale. In Table 1, the measurement items and their sources are listed.
To measure the confirmation of MIHS performance expectations, we used a four-item scale
To measure the confirmation of MIHS performance expectations, we used a four-item scale
adapted from previous studies [73]. Facilitating Condition (FC) was measured by a three-item scale
adapted from previous studies [73]. Facilitating Condition (FC) was measured by a three-item scale
adapted from previous studies [74,75]. Intention to continued use of MIHS was measured by a
adapted from previous studies [74,75]. Intention to continued use of MIHS was measured by a two-item
scale adapted from previous studies [74,76]. Perceived Interactivity (PI) was measured by a three-
item scale adapted from previous studies [77]. Perceived Risk (PR) was measured by a three-item
Int. J. Environ. Res. Public Health 2018, 15, 1972 10 of 23
two-item scale adapted from previous studies [74,76]. Perceived Interactivity (PI) was measured by a
three-item scale adapted from previous studies [77]. Perceived Risk (PR) was measured by a three-item
scale adapted from previous studies [78]. Perceived Usefulness (PU) was measured by a five-item scale
adapted from previous studies [79,80]. Patient Satisfaction with MIHS was measured by a two-item
scale and adapted from previous studies [80]. The seven-item scale for Electronic Word of Mouth
(WOM) behavior was also adapted from previous studies [4,81–84]. The users of MIHS are patients
and doctors, which are different from the classic users of a transactional application who use a system
for their daily operations. To ensure that all measurement instruments are reliable and valid for our
current study in the context of healthcare, we consulted with the relevant medical specialists and
experts in the field of management information systems and conducted the necessary adjustments and
adapted the scales to the special targeted respondents in the context of healthcare.
Based on these measures, we developed the survey questionnaire. After compiling the English
version of the questionnaire, the items were translated into Chinese by a bilingual faculty member
and then verified, refined, and back-translated for translation accuracy by a professor of healthcare
information management. The content validity of all scales was established through both a literature
review and a content validity expert panel comprising six faculty members and three doctoral students
who are experienced in the research methods of quantitative and quantitative analysis.
Table 1. Cont.
Patient Satisfaction PS01 I am pleased with my use of MIHS system. Bhattacherjee & Premkumar,
with MIHS PS02 I am satisfied with my use of MIHS system. 2004 [80]
4. Results
values of all the constructs are exceeding the cut-off value of 0.70 [89], which indicated adequate
internal consistency [90]. The AVE for each construct is higher than 0.50, suggesting that the observed
items explained more variance than the error terms [91]. In addition, the square root of the AVE
for each construct was higher than the correlations between the construct and all other constructs,
suggesting excellent discriminant validity. Thus, all scales of the measurement model demonstrate
adequate internal consistency for further analysis of the construct model.
Item Statistics
Construct
Construct Items Mean Std. Deviation Loading 1
CPE01 5.60 1.23 0.7951
Confirmation of MIHS CPE02 5.44 1.24 0.8270
performance expectations CPE03 5.61 1.23 0.8508
CPE04 5.78 1.19 0.8730
FC01 5.46 1.49 0.7480
Facilitating conditions FC02 5.65 1.38 0.8544
FC03 5.69 1.38 0.8572
ICU01 5.69 1.20 0.8950
Intention to continued use of MIHS
ICU02 5.62 1.29 0.8848
PI01 5.77 1.20 0.8293
Perceived interactivity PI02 5.86 1.19 0.8662
PI03 5.65 1.28 0.8163
PR01 3.41 1.93 0.8708
Perceived risk PR02 4.12 2.04 0.8440
PR03 3.86 1.91 0.7674
PU01 6.07 1.10 0.8150
PU02 6.02 1.10 0.7965
Perceived usefulness PU03 6.02 1.05 0.8435
PU04 5.93 1.16 0.8177
PU05 5.83 1.18 0.7494
PS01 5.75 1.45 0.8950
Patient satisfaction with MIHS
PS02 5.63 1.46 0.8848
WOM01 5.99 1.18 0.7999
WOM02 6.17 1.06 0.7809
WOM03 6.04 1.09 0.8258
Electronic word-of-mouth(WOM) WOM04 5.71 1.23 0.7823
WOM05 5.88 1.17 0.8102
WOM06 6.06 1.07 0.8084
WOM07 5.74 1.20 0.7869
1 The loading is reported by SmartPLS 2.0. It shows a high correlation level between observed variables and
structural variables.
Composite Cronbach’s
AVE 1 CPE FC ICU PI PR PU PS WOM
Reliability Alpha
CPE 0.8812 0.7981 0.7121 0.8439
FC 0.8705 0.7769 0.6916 0.7992 0.8316
ICU 0.8839 0.7374 0.7919 0.6429 0.6063 0.8899
PI 0.8756 0.788 0.7013 0.677 0.6183 0.7159 0.8374
PR 0.8676 0.7812 0.6865 −0.2154 −0.2115 −0.2218 −0.2235 0.8286
PU 0.8995 0.851 0.6912 0.6546 0.5965 0.6918 0.7817 −0.1018 0.8314
PS 0.9003 0.7786 0.8187 0.8016 0.7924 0.6238 0.6539 −0.1842 0.6277 0.9048
WOM 0.9294 0.9134 0.6221 0.7336 0.6848 0.6561 0.7174 −0.1365 0.7887 0.7199 0.7887
1AVE stands for Average Variance Extract. The bold numbers listed diagonally are the square root of the variance
shared between the constructs and their measures. The off-diagonal elements are the correlations among the
constructs. For discriminate validity, the diagonal elements should be larger than the off-diagonal elements.
Int. J. Environ. Res. Public Health 2018, 15, x FOR PEER REVIEW 14 of 23
WOM06. As a result, all of the construct correlation values are below 0.75. The highest construct VIF
Int. J. Environ.to
is lowered Res. PublicConstruct
2.521. Health 2018, reliability
15, 1972
validity are still established. The results show that14all
and of 23
of
the path coefficients are significant at 5% level. Using multiple commonly accepted approaches, we
haveCommon
4.2. shown that our results
Methods Varianceare not threaten by multicollinearity.
To test for
4.4. Structural Common Methods Variance (CMV), we conducted Harman’s single factor test.
Model
According to Podsakoff et al., if a detrimental level of common method bias exists, “(a) a single
To determine the statistical significance of the path coefficients, we ran the bootstrapping
factor will emerge from the exploratory factor analysis (unrotated) or (b) one general factor will
method setting the number of samples at 2000 and the number of cases at 494. The parameter
account for the majority of the covariance among the measures” ([92], p. 889). In the exploratory factor
estimated in the structural model exhibited the direct effects of one construct on the other; a
analysis of this study, more than one factor emerged to explain the variance, and one general factor
significant coefficient at a certain level of α reveals a significant relationship between the latent
did not account for most of the covariance among the measures. Thus, the common method bias in
constructs (Figure 3, Table 5).
this study is low.
H1, which hypothesized a positive relationship between patient satisfaction with MIHS and
electronic Word of Mouth (WOM) behavior, was supported (path coefficients = 0.508, p < 0.01).
4.3. Multicollinearity
Additionally, H2, which hypothesized a positive relationship between the intention to continue use
To ensure that there is no risk of multicollinearity, we tested the data and found that none of the
of MIHS and WOM behavior, was also supported (path coefficients = 0.339, p < 0.01). Satisfaction with
bivariate correlations was above 0.90 [93]. Additionally, the tolerance values, which are averaged to be2
MIHS and the intention to continue use of MIHS explain 58.8% of the variance in WOM behavior. R
greater than 0.30, are acceptable. The highest VIF among the constructs was 3.537. This is comparable
represents the degree of interpretation of the dependent variable by the independent variable.
to many prior studies and is well below the commonly accepted threshold: 10 [94]. This suggests
50%~60% is a suitable number. Patient satisfaction with MIHS has a positive and significant effect on
that multicollinearity is not severe in our research model. To further demonstrate that our results are
Intention to continued use of MIHS (H3) with path coefficients of 0.124 (p < 0.05). As predicted by H4
robust to multicollinearity, we removed the following measurement items (that caused high construct
and H5, confirmation of MIHS performance expectations significantly influenced patient satisfaction
correlation) and estimated the model again: CPE01, CPE04, FC01, PU03, PI02, WOM06. As a result,
with MIHS and perceived usefulness with path coefficients of 0.684 (p < 0.01) and 0.232 (p < 0.01),
all of the construct correlation values are below 0.75. The highest construct VIF is lowered to 2.521.
respectively. As predicted by H6 and H7, confirmation of MIHS performance expectations and
Construct reliability and validity are still established. The results show that all of the path coefficients
perceived usefulness significantly influenced the intention to continue use of MIHS with path
are significant at 5% level. Using multiple commonly accepted approaches, we have shown that our
coefficients of 0.18 (p < 0.01) and 0.279 (p < 0.01), respectively. Perceived interactivity had a positive
results are not threaten
and significant effect onby multicollinearity.
perceived usefulness (H8) with path coefficients of 0.625 (p < 0.01). Perceived
interactivity, perceived
4.4. Structural Model risk and facilitating conditions significantly influenced the intention to
continue use of MIHS with path coefficients of 0.322 (p < 0.01), -0.072 (p < 0.05) and 0.127 (p < 0.05),
To determine
respectively. the statistical
The path coefficientsignificance of the path
of H10 is negative coefficients,
because we ran thethat
we hypothesized bootstrapping method
perceived risk had
setting the impact
a negative numberon of the
samples at 2000
continued and
use the number
intention, that of
is, cases at 494.the
the higher The parameter
perceived estimated
risk, the less in the
likely
structural model exhibited the direct effects of one construct on the other; a significant
the patient would continue to use MIHS. All these indicators showed that the model fit the data well. coefficient at a
certain level of α reveals a significant relationship between
We will discuss these findings in detail in the next section. the latent constructs (Figure 3, Table 5).
0.127*
Facilitating Conditions
-0.072* Intention to
continued use of
Perceived Risk MIHS
R2=0.594
0.322**
Perceived Interactivity Electronic
0.339**
0.279** Word-of-
0.625** 0.124* Mouth(W
OM)
Perceived Usefulness
R2=0.588
R2=0.640
0.232**
0.180**
Patient 0.508**
Satisfaction with
Confirmation of MIHS MIHS
Performance R2=0.661
0.684**
Expectation
Figure 3.3.Model
Figure Modelresults. Path
results. coefficients
Path coefficients t value
withwith in parentheses;
t value * represents
in parentheses; p < 0.05; **
* represents p represents
< 0.05; **
prepresents
< 0.01. p < 0.01.
Int. J. Environ. Res. Public Health 2018, 15, 1972 15 of 23
H1, which hypothesized a positive relationship between patient satisfaction with MIHS and
electronic Word of Mouth (WOM) behavior, was supported (path coefficients = 0.508, p < 0.01).
Additionally, H2, which hypothesized a positive relationship between the intention to continue use of
MIHS and WOM behavior, was also supported (path coefficients = 0.339, p < 0.01). Satisfaction with
MIHS and the intention to continue use of MIHS explain 58.8% of the variance in WOM behavior.
R2 represents the degree of interpretation of the dependent variable by the independent variable.
50%~60% is a suitable number. Patient satisfaction with MIHS has a positive and significant effect
on Intention to continued use of MIHS (H3) with path coefficients of 0.124 (p < 0.05). As predicted
by H4 and H5, confirmation of MIHS performance expectations significantly influenced patient
satisfaction with MIHS and perceived usefulness with path coefficients of 0.684 (p < 0.01) and
0.232 (p < 0.01), respectively. As predicted by H6 and H7, confirmation of MIHS performance
expectations and perceived usefulness significantly influenced the intention to continue use of MIHS
with path coefficients of 0.18 (p < 0.01) and 0.279 (p < 0.01), respectively. Perceived interactivity had a
positive and significant effect on perceived usefulness (H8) with path coefficients of 0.625 (p < 0.01).
Perceived interactivity, perceived risk and facilitating conditions significantly influenced the intention
to continue use of MIHS with path coefficients of 0.322 (p < 0.01), -0.072 (p < 0.05) and 0.127 (p < 0.05),
respectively. The path coefficient of H10 is negative because we hypothesized that perceived risk had a
negative impact on the continued use intention, that is, the higher the perceived risk, the less likely
the patient would continue to use MIHS. All these indicators showed that the model fit the data well.
We will discuss these findings in detail in the next section.
5.1. Discussion
In this study, we focused on the impact factors that influence patient electronic word-of-mouth
(WOM) based on post-adoption behavior and ECM-IT. The empirical results supported all research
hypotheses and proved the significant impact of the use of MIHS on patient WOM behaviors.
The supported H1 and H2 indicated that patient satisfaction and the continuous use of MIHS had
a significant positive influence on improving the patient WOM, and the supported H3 shows that
satisfaction with MIHS could promote the intention to continue using MIHS. The empirical results
of H6 and H7 indicated that the perceived usefulness of MIHS had a positive influence on patient
satisfaction and continuous use of MIHS. Both the perceived interactivity and confirmation of MIHS
performance expectations positively and significantly affected the perceived usefulness.
From the IT perspective, we mainly studied MIHS. MIHS is an emerging generation of healthcare
system platforms that provide interactions between hospital staff and patients, and allow patients
to access various pieces of healthcare information through smartphones. The main characteristics of
Int. J. Environ. Res. Public Health 2018, 15, 1972 16 of 23
MIHS are accessible to both doctors and patients, and allows for convenient interactions with one
another. The use of this novel MIHS is powerful for doctor-patient interactivity experience.
In our study, the perceived interactivity enhanced the perceived usefulness. This is understandable
because the interactivity of MIHS helps patients ascertain their healthcare situation instantly and
obtain suggestions by consulting with their doctors at any time. Perceived interactivity and perceived
usefulness helped users make decisions on their continued use of MIHS. Perceived usefulness also
promoted patient satisfaction experience. The patients with higher satisfaction levels were more likely
to continuously use MIHS, which was consistent with a previous study [16]. The patient expectation
confirmation on MIHS performance was also an important factor when evaluating the patient perceived
usefulness of and satisfaction with the system. Facilitating conditions, such as increasingly convenient
WiFi and 3G networks, as well as increasingly widespread use of smartphones and WeChat, further
enhanced continued use of MIHS. The reduction of perceived risk also improved users’ intention to
continued use of MIHS, further motivating their WOM behavior.
There are five pathways to “use intention” (H9 vs. H8 + H7). The pathways are a little complicated
but is normal in this kind of SEM-based behavioral and empirical study. Based on the results of data
analysis, there are two main pathways (path coefficients are over 0.25). For a specific individual, it is
possible for him to have high perceived interactivity but low perceived usefulness. But for our study,
our conclusion is based on SEM-based statistical analysis. This phenomenon with high perceived
interactivity but low perceived usefulness will not cause influence on our conclusion.
5.2. Implications
trust and relationships between doctors and patients [96]. In fact, the purposes of IT use are to improve
efficiency and performance. In the context of online healthcare, the continued use of MIHS could
improve the communication efficiency between doctors and patients, encourage trust [97], and improve
the WOM of patients. Our research could help promote this type of study in theory to further focus on
the purpose and effectiveness of IT implementation in depth in the internet medicine era.
5.3. Limitations
This paper analyzed the main mechanisms of how the features and users’ experiences of MIHS
influenced patient satisfaction and continuous use behaviors of the system to generate additional
WOM dissemination behaviors. This study could link the improving trust of doctors and patients to
the use of MIHS. However, there are some limitations that can be addressed by further studies.
Firstly, we used continued use intention rather than actual use behavior. In the research area of
information systems use, most researchers only studied behavioral intention rather than behaviors [99],
because it is not easy to obtain the real use data by survey methodology. We did not follow up and
track the actual use of MIHS, considering its difficulty and complications. It is a challenging issue
to explore other means of obtaining data. It is a further challenge to include other research methods
to obtain data indicating specific individual use of modules from MIHS data bases, as permitted
by policies associated with the use, disclosure, and privacy protection of individual healthcare data.
Future studies could consider how to establish dynamic tracking mechanism of patients continued
use behaviors.
Secondly, this paper did not analyze individual differences, so the impact mechanisms of MIHS
on patient satisfaction in different populations are not clear. In fact, the attribute variables have shown
a significant influence in the medical service area [100,101]. Future studies should further explore the
moderating effects of these attribute variables.
Int. J. Environ. Res. Public Health 2018, 15, 1972 18 of 23
The third one is that our study did not consider excluding patients who could not read or write
although the number of such participants is small.
Author Contributions: D.G. conceived the research, X.Y. wrote the draft; X.Y. collected the data and conducted
data analysis; C.L., H.K.J. and X.L. provided some guiding suggestions and revised the paper.
Acknowledgments: This research is partially supported in the collection, analysis and interpretation of data by
the National Natural Science Foundation of China under Grant Nos. 71331002, 71771075, 71771077, 71573071,
and 71601061.
Int. J. Environ. Res. Public Health 2018, 15, 1972 19 of 23
References
1. Sundberg, K.; Eklöf, A.L.; Blomberg, K.; Isaksson, A.K.; Wengström, Y. Feasibility of an interactive
ICT-platform for early assessment and management of patient-reported symptoms during radiotherapy for
prostate cancer. Eur. J. Oncol. Nurs. 2015, 19, 523–528. [CrossRef] [PubMed]
2. Huppertz, J.W.; Carlson, J.P. Consumers’ use of HCAHPS ratings and word-of-mouth in hospital choice.
Health Serv. Res. 2010, 45, 1602–1613. [CrossRef] [PubMed]
3. Yang, H.; Guo, X.; Wu, T.; Ju, X. Exploring the effects of patient-generated and system-generated information
on patients’ online search, evaluation and decision. Electron. Commer. Res. Appl. 2015, 14, 192–203. [CrossRef]
4. Anderson, E. Customer satisfaction and word of mouth. J. Serv. Res. 1998, 1, 5–17. [CrossRef]
5. Kucukarslan, S.N.; Nadkarni, A. Evaluating medication-related services in a hospital setting using the
disconfirmation of expectations model of satisfaction. Res. Soc. Adm. Pharm. 2008, 4, 12. [CrossRef]
[PubMed]
6. Yan, Q.; Zhou, S.; Wu, S. The influences of tourists’ emotions on the selection of electronic word of mouth
platforms. Tour. Manag. 2018, 66, 348–363. [CrossRef]
7. Hennig-Thurau, T.; Gwinner, K.P.; Walsh, G.; Gremler, D.D. Electronic word-of-mouth via consumer-opinion
platforms: What motivates consumers to articulate themselves on the Internet? J. Interact. Mark. 2004, 18,
38–52. [CrossRef]
8. Hussain, S.; Guangju, W.; Jafar, R.M.S.; Ilyas, Z.; Mustafa, G.; Jianzhou, Y. Consumers’ online
information adoption behavior: Motives and antecedents of electronic word of mouth communications.
Comput. Hum. Behav. 2018, 80, 22–32. [CrossRef]
9. Drevs, F.; Hinz, V. Who chooses, who uses, who rates: The impact of agency on electronic word-of-mouth
about hospitals stays. Health Care Manag. Rev. 2013, 39, 223–233. [CrossRef] [PubMed]
10. Wu, W.Y. Influences on the perceived value of medical travel: The moderating roles of risk attitude,
self-esteem and word-of-mouth. Curr. Issues Tour. 2016, 19, 1–15. [CrossRef]
11. Fakharyan, M.; Omidvar, S.; Khodadadian, M.R.; Jalilvand, M.R.; Vosta, L.N. Examining the effect of
customer-to-customer interactions on satisfaction, loyalty, and word-of-mouth behaviors in the hospitality
industry: The mediating role of personal interaction quality and service atmospherics. J. Travel Tour. Mark.
2014, 31, 610–626. [CrossRef]
12. Kitapci, O.; Akdogan, C.; Dortyol, I.T. The impact of service quality dimensions on patient satisfaction,
repurchase intentions and word-of-mouth communication in the public healthcare industry. Procedia Soc.
Behav. Sci. 2014, 148, 161–169. [CrossRef]
13. Delpierre, C.; Cuzin, L.; Fillaux, J.; Alvarez, M.; Massip, P.; Lang, T. A systematic review of computer-based
patient record systems and quality of care: More randomized clinical trials or a broader approach? Int. J.
Qual. Health Care 2004, 16, 407–416. [CrossRef] [PubMed]
14. Jenkinson, C.; Coulter, A.; Bruster, S.; Richards, N.; Chandola, T. Patients’ experiences and satisfaction with
health care: Results of a questionnaire study of specific aspects of care. Qual. Saf. Health Care 2002, 11,
335–339. [CrossRef] [PubMed]
15. Amin, I.M.; Hussein, S.S.; Isa, W.A. Assessing user satisfaction of using hospital information system (HIS) in
Malaysia. People 2011, 12, 13.
16. Davis, F.D. Perceived usefulness, perceived ease of use, and user acceptance of information technology.
MIS Q. 1989, 13, 319–340. [CrossRef]
17. Melas, C.D.; Zampetakis, L.A.; Dimopoulou, A.; Moustakis, V. Modeling the acceptance of clinical
information systems among hospital medical staff: An extended TAM model. J. Biomed. Inform. 2011,
44, 553–564. [CrossRef] [PubMed]
18. Bhattacherjee, A. Understanding information systems continuance: An expectation-confirmation model.
MIS Q. 2001, 25, 351–370. [CrossRef]
19. Yang, S.; Lu, Y.; Chau, P.Y.K. Why do consumers adopt online channel? An empirical investigation of two
channel extension mechanisms. Decis. Support Syst. 2013, 54, 858–869. [CrossRef]
20. Cho, J. The impact of post-adoption beliefs on the continued use of health apps. Int. J. Med. Inform. 2016, 87,
75–83. [CrossRef] [PubMed]
Int. J. Environ. Res. Public Health 2018, 15, 1972 20 of 23
21. Bhattacherjee, A.; Lin, C.-P. A unified model of IT continuance: Three complementary perspectives and
crossover effects. Eur. J. Inf. Syst. 2015, 24, 364–373. [CrossRef]
22. Bagayogo, F.F.; Lapointe, L.; Bassellier, G. Enhanced use of IT: A new perspective on post-adoption. J. Assoc.
Inf. Syst. 2014, 15, 361. [CrossRef]
23. Mouakket, S. Factors influencing continuance intention to use social network sites: The Facebook case.
Comput. Hum. Behav. 2015, 53, 102–110. [CrossRef]
24. Cheung, C.M.; Thadani, D.R. The impact of electronic word-of-mouth communication: A literature analysis
and integrative model. Decis. Support Syst. 2012, 54, 461–470. [CrossRef]
25. Libai, B.; Muller, E.; Peres, R. Decomposing the value of word-of-mouth seeding programs: Acceleration
versus expansion. J. Mark. Res. 2013, 50, 161–176. [CrossRef]
26. Oh, H.; Animesh, A.; Pinsonneault, A. Free versus for-a-fee: The impact of a paywall on the pattern and
effectiveness of word-of-mouth via social media. MIS Q. 2016, 40, 31–56. [CrossRef]
27. Sweeney, J.; Soutar, G.; Mazzarol, T. Factors enhancing word-of-mouth influence: Positive and negative
service-related messages. Eur. J. Mark. 2014, 48, 336–359. [CrossRef]
28. Wang, N.; Shen, X.L.; Sun, Y. Transition of electronic word-of-mouth services from web to mobile context:
A trust transfer perspective. Decis. Support Syst. 2013, 54, 1394–1403. [CrossRef]
29. King, R.A.; Racherla, P.; Bush, V.D. What we know and don’t know about online word-of-mouth: A review
and synthesis of the literature. J. Interact. Mark. 2014, 28, 167–183. [CrossRef]
30. Aghakhani, N.; Karimi, J.; Salehan, M. A unified model for the adoption of electronic word of mouth on
social network sites: Facebook as the exemplar. Int. J. Electron. Commer. 2018, 22, 202–231. [CrossRef]
31. Baek, H.; Oh, S.; Yang, H.D.; Ahn, J. Electronic word-of-mouth, box office revenue and social media.
Electron. Commer. Res. Appl. 2017, 22, 13–23. [CrossRef]
32. Leong, L.Y.; Hew, T.S.; Ooi, K.B.; Lin, B. Do electronic word-of-mouth and elaboration likelihood model
influence hotel booking? J. Comput. Inf. Syst. 2017, 1–15. [CrossRef]
33. Berger, J. Word of mouth and interpersonal communication: A review and directions for future research.
J. Consum. Psychol. 2014, 24, 586–607. [CrossRef]
34. Li, H.; Liu, Y. Understanding post-adoption behaviors of e-service users in the context of online travel
services. Inf. Manag. 2014, 51, 1043–1052. [CrossRef]
35. Ha, Y.; Im, H. Role of web site design quality in satisfaction and word of mouth generation. J. Serv. Manag.
2012, 23, 79–96. [CrossRef]
36. Chen, Y.-S.; Lin, C.-L.; Chang, C.-H. The influence of green wash on green word-of-mouth (green WOM):
The mediation effects of green perceived quality and green satisfaction. Qual. Quant. 2014, 48, 2411–2425.
[CrossRef]
37. Lam, D.; So, A. Do happy tourists spread more word-of-mouth? The mediating role of life satisfaction.
Ann. Tour. Res. 2013, 43, 646–650. [CrossRef]
38. Choudhury, K. Service quality and word of mouth: A study of the banking sector. Int. J. Bank Mark. 2014, 32,
612–627. [CrossRef]
39. Lin, C.S.; Wu, S.; Tsai, R.J. Integrating perceived playfulness into expectation-confirmation model for web
portal context. Inf. Manag. 2005, 42, 683–693. [CrossRef]
40. Thong, J.Y.; Hong, S.-J.; Tam, K.Y. The effects of post-adoption beliefs on the expectation-confirmation model
for information technology continuance. Int. J. Hum. Comput. Stud. 2006, 64, 799–810. [CrossRef]
41. Wong, C.-H.; Tan, G.W.-H.; Loke, S.-P.; Ooi, K.-B. Adoption of mobile social networking sites for learning?
Online Inf. Rev. 2015, 39, 762–778. [CrossRef]
42. Shi, N.; Lee, M.K.; Cheung, C.; Chen, H. The continuance of online social networks: How to keep people
using Facebook? In Proceedings of the 2010 43rd Hawaii International Conference on System Sciences
(HICSS), Honolulu, HI, USA, 5–8 January 2010; pp. 1–10. [CrossRef]
43. Hong, S.J.; Thong, J.; Tam, K.Y. Understanding continued IT usage: An extension to the
expectation-confirmation model in IT domain. In Proceedings of the Pacific Asia Conference on Information
Systems, PACIS 2005, Bangkok, Thailand, 7–10 July 2005.
44. Holton, A.E.; Baek, K.; Coddington, M.; Yaschur, C. Seeking and sharing: Motivations for linking on Twitter.
Commun. Res. Rep. 2014, 31, 33–40. [CrossRef]
Int. J. Environ. Res. Public Health 2018, 15, 1972 21 of 23
45. Jones, C.D.; Holmes, G.M.; Lewis, S.E.; Thompson, K.W.; Cykert, S.; DeWalt, D.A. Satisfaction with electronic
health records is associated with job satisfaction among primary care physicians. J. Innov. Health Inform.
2013, 21, 18–20. [CrossRef] [PubMed]
46. Closs, D.J.; Savitskie, K. Internal and external logistics information technology integration. Int. J.
Logist. Manag. 2003, 14, 63–76. [CrossRef]
47. Gulati, R.; Garino, J. Get the right mix of bricks & clicks. Harv. Bus. Rev. 1999, 78, 107–114.
48. Davis, F.D. A Technology Acceptance Model for Empirically Testing New End-User Information Systems:
Theory and Results. Ph.D. Thesis, Massachusetts Institute of Technology, Cambridge, MA, USA, 1985.
49. Dutta-Bergman, M.J. The impact of completeness and web use motivation on the credibility of e-Health
information. J. Commun. 2004, 54, 253–269. [CrossRef]
50. Bøe, T.; Gulbrandsen, B.; Sørebø, Ø. How to stimulate the continued use of ICT in higher education:
Integrating Information Systems Continuance Theory and agency theory. Comput. Hum. Behav. 2015, 50,
375–384. [CrossRef]
51. Zhao, L.; Lu, Y. Enhancing perceived interactivity through network externalities: An empirical study on
micro-blogging service satisfaction and continuance intention. Decis. Support Syst. 2012, 53, 825–834.
[CrossRef]
52. McMillan, S.J.; Hwang, J.-S. Measures of perceived interactivity: An exploration of the role of direction of
communication, user control, and time in shaping perceptions of interactivity. J. Advert. 2002, 31, 29–42.
[CrossRef]
53. Shipps, B. Social networks, interactivity and satisfaction: Assessing socio-technical behavioral factors as an
extension to technology acceptance. J. Theor. Appl. Electron. Commer. Res. 2013, 8, 35–52. [CrossRef]
54. Yu, X.; Roy, S.K.; Quazi, A.; Nguyen, B.; Han, Y. Internet entrepreneurship and “the sharing of information”
in an Internet-of-Things context: The role of interactivity, stickiness, e-satisfaction and word-of-mouth in
online SMEs’ websites. Internet Res. 2017, 27, 74–96. [CrossRef]
55. Liu, J.; Li, C.; Ji, Y.G.; North, M.; Yang, F. Like it or not: The Fortune 500’s Facebook strategies to generate
users’ electronic word-of-mouth. Comput. Hum. Behav. 2017, 73, 605–613. [CrossRef]
56. Lee, D.; Moon, J.; Kim, Y.J.; Yi, M.Y. Antecedents and consequences of mobile phone usability: Linking
simplicity and interactivity to satisfaction, trust, and brand loyalty. Inf. Manag. 2015, 52, 295–304. [CrossRef]
57. Abdullah, D.; Jayaraman, K.; Kamal, S.B.M. A conceptual model of interactive hotel website: The role
of perceived website interactivity and customer perceived value toward website revisit intention.
Procedia Econ. Finance 2016, 37, 170–175. [CrossRef]
58. Kent, C.; Laslo, E.; Rafaeli, S. Interactivity in online discussions and learning outcomes. Comput. Educ. 2016,
97, 116–128. [CrossRef]
59. Johnson, T.J.; Kaye, B.K. Some like it lots: The influence of interactivity and reliance on credibility.
Comput. Hum. Behav. 2016, 61, 136–145. [CrossRef]
60. Bauer, R.A. Consumer behavior as risk taking. In Proceedings of the 43rd National Conference of the
American Marketing Assocation, Chicago, IL, USA, 15–17 June 1960.
61. Featherman, M.S.; Pavlou, P.A. Predicting e-services adoption: A perceived risk facets perspective. Int. J.
Hum. Comput. Stud. 2003, 59, 451–474. [CrossRef]
62. Malhotra, N.K.; Kim, S.S.; Agarwal, J. Internet users’ information privacy concerns (IUIPC): The construct,
the scale, and a causal model. Inf. Syst. Res. 2004, 15, 336–355. [CrossRef]
63. Van der Heijden, H.; Verhagen, T.; Creemers, M. Understanding online purchase intentions: Contributions
from technology and trust perspectives. Eur. J. Inf. Syst. 2003, 12, 41–48. [CrossRef]
64. Green, D.T.; Pearson, J.M. Integrating website usability with the electronic commerce acceptance model.
Behav. Inf. Technol. 2011, 30, 181–199. [CrossRef]
65. Li, Y.H.; Huang, J.W. Applying theory of perceived risk and technology acceptance model in the online
shopping channel. Int. J. Bus. Econ. Finance Manag. 2009, 53, 919–925.
66. Lu, H.P.; Hsu, C.L.; Hsu, H.Y. An empirical study of the effect of perceived risk upon intention to use online
applications. Inf. Manag. Comput. Secur. 2005, 13, 106–120. [CrossRef]
67. Venkatesh, V.; Morris, M.G.; Davis, G.B.; Davis, F.D. User acceptance of information technology: Toward a
unified view. MIS Q. 2003, 425–478. [CrossRef]
68. Ma, Q.; Chan, A.H.; Chen, K. Personal and other factors affecting acceptance of smartphone technology by
older Chinese adults. Appl. Ergon. 2016, 54, 62–71. [CrossRef] [PubMed]
Int. J. Environ. Res. Public Health 2018, 15, 1972 22 of 23
69. Hsieh, J.P.-A.; Rai, A.; Keil, M. Understanding digital inequality: Comparing continued use behavioral
models of the socio-economically advantaged and disadvantaged. MIS Q. 2008, 97–126. [CrossRef]
70. Venkatesh, V.; Sykes, T.A. Digital divide initiative success in developing countries: A longitudinal field study
in a Village in India. Inf. Syst. Res. 2013, 24, 239–260. [CrossRef]
71. Barnard, Y.; Bradley, M.D.; Hodgson, F.; Lloyd, A.D. Learning to use new technologies by older adults:
Perceived difficulties, experimentation behavior and usability. Comput. Hum. Behav. 2013, 29, 1715–1724.
[CrossRef]
72. Liao, C.; Chen, J.-L.; Yen, D.C. Theory of planning behavior (TPB) and customer satisfaction in the continued
use of e-service: An integrated model. Comput. Hum. Behav. 2007, 23, 2804–2822. [CrossRef]
73. Hong, S.J.; Thong, J.Y.L.; Tam, K.Y. Understanding continued information technology usage behavior:
A comparison of three models in the context of mobile internet. Decis. Support Syst. 2006, 42, 1819–1834.
[CrossRef]
74. Ajzen, I. The theory of planned behavior. Organ. Behav. Hum. Decis. Process. 1991, 50, 179–211. [CrossRef]
75. Taylor, S.; Todd, P.A. Understanding information technology usage: A test of competing models.
Inf. Syst. Res. 1995, 6, 144–176. [CrossRef]
76. Ajzen, I.; Madden, T.J. Prediction of goal-directed behavior-attitudes, intentions, and perceived
behavioral-control. J. Exp. Soc. Psychol. 1986, 22, 453–474. [CrossRef]
77. Song, J.; Zahedi, F.M. A theoretical approach to web design in e-commerce: A belief reinforcement model.
Manag. Sci. 2005, 51, 1219–1235. [CrossRef]
78. McKnight, D.H.; Choudhury, V.; Kacmar, C. The impact of initial consumer trust on intentions to transact
with a web site: A trust building model. J. Strateg. Inf. Syst. 2002, 11, 297–323. [CrossRef]
79. Yoon, C. The effects of national culture values on consumer acceptance of e-commerce: Online shoppers in
China. Inf. Manag. 2009, 46, 294–301. [CrossRef]
80. Bhattacherjee, A.; Premkumar, G. Understanding changes in belief and attitude toward information
technology usage: A theoretical model and longitudinal test. MIS Q. 2004, 28, 229–254. [CrossRef]
81. Harrison-Walker, L.J. The measurement of word-of-mouth communication and an investigation of service
quality and customer commitment as potential antecedents. J. Serv. Res. 2001, 4, 60–75. [CrossRef]
82. Andrei, A.G. A word-of-mouse approach for word-of-mouth measurement. USV Ann. Econ. Public Adm.
2013, 12, 87–93.
83. Kim, W.G.; Han, J.S.; Lee, E. Effects of relationship marketing on repeat purchase and word of mouth. J. Hosp.
Tour. Res. 2001, 25, 272–288. [CrossRef]
84. Singh, J. Voice, exit, and negative word-of-mouth behaviors: An investigation across three service categories.
J. Acad. Mark. Sci. 1990, 18, 1–15. [CrossRef]
85. Hair, J.F.; Sarstedt, M.; Ringle, C.M.; Mena, J.A. An assessment of the use of partial least squares structural
equation modeling in marketing research. J. Acad. Mark. Sci. 2012, 40, 414–433. [CrossRef]
86. Ringle, C.M.; Sarstedt, M.; Straub, D. A critical look at the use of PLS-SEM in MIS quarterly. MIS Q. 2012, 36,
iii–xiv.
87. Lu, I.R.R.; Kwan, E.; Thomas, D.R.; Cedzynski, M. Two new methods for estimating structural equation
models: An illustration and a comparison with two established methods. Int. J. Res. Mark. 2011, 28, 258–268.
[CrossRef]
88. Nunnally, J.C. Psychometric Theory; McGraw-Hill: New York, NY, USA, 1978.
89. Bagozzi, R.P. Causal Models in Marketing; Wiley: New York, NY, USA, 1980.
90. Nunnally, J.C.; Bernstein, I. Psychological Theory; McGraw-Hill: New York, NY, USA, 1994.
91. Fornell, C.; Larcker, D.F. Evaluating structural equation models with unobservable variables and
measurement error. J. Mark. Res. 1981, 39–50. [CrossRef]
92. Podsakoff, P.M.; Mackenzie, S.B.; Lee, J.Y.; Podsakoff, N.P. Common method biases in behavioral research:
A critical review of the literature and recommended remedies. J. Appl. Psychol. 2003, 88, 879–903. [CrossRef]
[PubMed]
93. Tabachnick, B.G.; Fidell, L.S.; Osterlind, S.J. Using Multivariate Statistics, 5th ed.; Allyn & Bacon: Needham
Height, MA, USA, 2007.
94. Tan, C.-W.; Benbasat, I.; Cenfetelli, R.T. IT-mediated customer service content and delivery in electronic
governments: An empirical investigation of the antecedents of service quality. MIS Q. 2013, 37. [CrossRef]
Int. J. Environ. Res. Public Health 2018, 15, 1972 23 of 23
95. Bowen, D.E.; Schneider, B. Services marketing and management-implications for organizational-behavior.
Res. Organ. Behav. 1988, 10, 43–80.
96. Egea, J.M.O.; González, M.V.R. Explaining physicians’ acceptance of EHCR systems: An extension of TAM
with trust and risk factors. Comput. Hum. Behav. 2011, 27, 319–332. [CrossRef]
97. Liang, C.; Gu, D.; Tao, F.; Jain, H.K.; Zhao, Y.; Ding, B. Influence of mechanism of patient-accessible
hospital information system implementation on doctor–patient relationships: A service fairness perspective.
Inf. Manag. 2016, 54, 57–72. [CrossRef]
98. Ong, C.-S.; Lai, J.-Y.; Wang, Y.-S. Factors affecting engineers’ acceptance of asynchronous e-learning systems
in high-tech companies. Inf. Manag. 2004, 41, 795–804. [CrossRef]
99. Sheng, D.F.; Sun, J.J. A Review of the Factors Affecting Knowledge Sharing Behavior in Foreign Virtual
Community Environments. Inf. Sci. 2016, 34, 166–172.
100. Marx, K.A.; Stanley, I.H.; Van, H.K.; Moody, J.; Alonzi, D.; Hansen, B.R.; Gitlin, L.N. Knowing versus
doing: Education and training needs of staff in a chronic care hospital unit for individuals with dementia.
J. Gerontol. Nurs. 2014, 40, 36–37. [CrossRef] [PubMed]
101. Zhang, K.Z.K.; Cheung, C.M.K.; Lee, M.K.O. Examining the moderating effect of inconsistent reviews and
its gender differences on consumers’ online shopping decision. Int. J. Inf. Manag. 2014, 34, 89–98. [CrossRef]
102. Gu, D.X.; Zhang, Y.; Gu, Z.Z. Research on positive public opinion information dissemination model of social
network based on expectation confirmation theory. Inf. Sci. 2016, 34, 29–34.
© 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).