Academia.eduAcademia.edu

An Effective Approach for Evaluating Usability of Web Sites

2013, Enterprise Business Modeling, Optimization Techniques, and Flexible Information Systems

University Websites have been one of the important Websites for students, university personnel, and researchers. However, usability has long been a major concern within Websites. This chapter develops an evaluation approach using usability criteria and the Fuzzy Analytic Hierarchy Process (FAHP) for the comparison of Websites in a fuzzy environment. Firstly, alternative Websites are examined by experts using usability criteria in the literature. Then, FAHP is used to determine the usability criteria weights from subjective and imprecise judgments of the experts. Finally, Websites are compared based on usability criteria weights.

97 Chapter 8 An Effective Approach for Evaluating Usability of Web Sites Emel Kızılkaya Aydogan Erciyes University, Turkey Elif Kılıc Delice Ataturk University, Turkey Petraq Papajorgji European University of Tirana, Albania ABSTRACT University Websites have been one of the important Websites for students, university personnel, and researchers. However, usability has long been a major concern within Websites. This chapter develops an evaluation approach using usability criteria and the Fuzzy Analytic Hierarchy Process (FAHP) for the comparison of Websites in a fuzzy environment. Firstly, alternative Websites are examined by experts using usability criteria in the literature. Then, FAHP is used to determine the usability criteria weights from subjective and imprecise judgments of the experts. Finally, Websites are compared based on usability criteria weights. 1. INTRODUCTION Today people increasingly expect more from the functionality of a Web site, so the Web usability has emerged as an important topic. Users pay more attention to ease of use property of Web site so as any other product. However, there is an increasing importance for higher usability in the Web development industry and communities. Therefore, the designers aim for Web site with high usability (Delice and Gungor, 2009). Usability not a single property, but a combination of several properties and attributes (Liljegren, 2006). Therefore, there are many definitions of usability in the literature (Constantine and Lockwood, 1999; Hix and Hartson, DOI: 10.4018/978-1-4666-3946-1.ch008 Copyright © 2013, IGI Global. Copying or distributing in print or electronic forms without written permission of IGI Global is prohibited. An Effective Approach for Evaluating Usability of Web Sites 1993; Shackel, 1991; Nielsen, 1993; Preece et al., 1994; Shneiderman, 1986; Wixon and Wilson, 1997). Those definitions have resulted in different definitions of usability, because authors have different opinions on how to measure usability. However, there are many evaluation approaches and techniques are based upon specific definitions of usability. In the expert judgment-based approach which is one type of evaluation approach, experts mostly rely on their experience to make a judgment on the ergonomic quality of alternative interfaces (Folmer and Bosch, 2004). In case of lacking experience, they appraise alternatives with user interface design guidelines (Nielsen, 1993; Smith and Mosier, 1986; Shneiderman, 1992), established human factors principles and standards (e.g., ISO, ANSI, DIN, etc.), and criteria (Ravden and Johnson, 1989; Scapin, 1990). In view of the multiplicity of criteria inherent in such decision-making situations, the methodology of Multiple-Criteria Decision Making (MCDM) is used as the framework of analysis (Park and Lim, 1999). MCDM is a powerful tool used widely for evaluating and ranking problems containing multiple, usually conflicting criteria. In the usability literature, Analytic Hierarchy Process (AHP), has been widely used MCDM technique, is generally used to weight the usability criteria and evaluate the interfaces based on weights of these criteria. (Park and Lim, 1999) tried to select an interface among alternatives by using the usability criteria and measures. The selection of these interfaces took place in two steps. In the first step, AHP was used to weight the usability criteria with expert based evaluation and some of the interfaces were eliminated. In the second one, usability testing was performed. In another study by (Mitta, 1993), computer interfaces were evaluated by AHP based on usability and learning-ability criteria, and a selection was made among alternative computer interfaces. The study, thus, shows that AHP can be applied to subjective data which are obtained from studies on human factors. (Ji et al., 2007) developed an 98 AHP evaluation model for haptic interface design with quantitative assessments of the prototype by finding out the absolute and relative importance for evaluation groups and factors in early design levels. Finally, different from previous studies, (Delice and Gungor, 2009) used AHP to prioritize the usability problems which were defined by Heuristic Evaluation (HE). In this study, first, usability problems are detected by HE method and then severity ratings of these problems are evaluated by AHP. As a result, HE is arranged by using AHP. AHP method is often criticized for its traditional formulation in the literature. In the traditional formulation of the AHP, personal judgments are represented with crisp values. However, in many practical cases, the human preference model is uncertain and decision-makers might be reluctant or unable to assign crisp values to the comparison judgments. The use of fuzzy set theory allows the decision-makers to incorporate unquantifiable information, incomplete information, non-obtainable information into decision model (Zadeh, 1965; Kulak et al., 2005). Therefore, Fuzzy Analytic Hierarchy Process (FAHP), a fuzzy extension of AHP, is developed to solve the hierarchical fuzzy problems (Kahraman et al., 2004). In FAHP method, a Decision Maker (DM) is allowed to provide fuzzy judgments instead of precise comparisons. A number of methods have been developed to deal with fuzzy comparison matrices such as modified Fuzzy Logarithmic Least Squares Method (modified fuzzy LLSM) in the FAHP (Wang et al., 2006). In the present study, the objective is to evaluate a subset of alternatives using usability criteria and FAHP. Firstly, alternative Web sites is examined by experts using existing usability criteria in the literature. Then, modified fuzzy LLSM in the FAHP is used to determine the usability criteria weights from subjective and imprecise judgments of the experts. Finally, Web sites have been compared based on usability criteria weights and selected the best alternative Web site in fuzzy enviroment. 9 more pages are available in the full version of this document, which may be purchased using the "Add to Cart" button on the product's webpage: www.igi-global.com/chapter/effective-approach-evaluating-usabilityweb/77963?camid=4v1 This title is available in InfoSci-Business Technologies, InfoSci-Books, Business, Administration, and Management, InfoSci-Business and Management, InfoSci-Select, InfoSci-Computer Science and Information Technology, Science, Engineering, and Information Technology, InfoSciSelect, InfoSci-Select. Recommend this product to your librarian: www.igi-global.com/e-resources/library-recommendation/?id=37 Related Content Whole-of-Enterprise Approach to Government Architecture Applied for Implementing a Directive of EU Ivo Velitchkov (2012). Enterprise Architecture for Connected E-Government: Practices and Innovations (pp. 247-261). www.igi-global.com/chapter/whole-enterprise-approach-governmentarchitecture/67025?camid=4v1a Consortium Agreement Template for Virtual Enterprises José D. Carvalho, Nuno A. Moreira and Luís C. Pires (2005). Virtual Enterprise Integration: Technological and Organizational Perspectives (pp. 366-381). www.igi-global.com/chapter/consortium-agreement-template-virtualenterprises/30867?camid=4v1a An Exploratory Study on the Influencers of the Perceived Relevance of CIO's Activities and Skills: An Update João Varajão, António Trigo and Pedro Soto-Acosta (2017). Enterprise Information Systems and the Digitalization of Business Functions (pp. 401-421). www.igi-global.com/chapter/an-exploratory-study-on-the-influencers-of-the-perceived-relevanceof-cios-activities-and-skills/177353?camid=4v1a Enterprise Systems and Data Analytics: A Fantasy Football Case Study Carmine Sellitto and Paul Hawking (2015). International Journal of Enterprise Information Systems (pp. 112). www.igi-global.com/article/enterprise-systems-and-data-analytics/138828?camid=4v1a