PROCEEDINGS OF THE THIRD

INTERNATIONAL CONFERENCE
ON INFORMATICS AND
COMPUTING (ICIC 2018)
Strengthening Nation Competitiveness
through Intelligent Computing
in the Current Digital Disruption Era

Aryaduta Hotel Palembang

South Sumatera - Indonesia

17-18 October 2018

 MESSAGE FROM THE GENERAL CHAIR

Our understanding of the shifts that disrupt businesses, industries, and sectors has profoundly improved over
the past 30 years: We know far more about how to identify the shifts and what dangers their pose in the
Disruption technology, although, there is still a need to better understand the nature of disruptions and their
relationship to emerging technology. A disruptive technology displaces an established technology and shakes
up the ground-breaking product and innovation that creates a completely new industry. “Emerging
technology”, “disruptive innovation”, and “disruptive technology” have evolved as frequently used concepts
in scientific literature on Science, Technology and Innovation. In many contexts, including academic and
professional literature, the usage of these concepts may obfuscate their meaning to researchers and
practitioners.
Considering these intelligent computing innovation and disruptive innovation, the The 3rd International
Conference on Informatics and Computing (ICIC 2018) has its theme as "Strengthening Nation
Competitiveness through Intelligent Computing in the Current Digital Disruption Era”. Our goal is to bring
together leading academic scientists, researchers and research scholars to exchange and share their
experiences and research results on all aspects of Informatics Engineering, Computing Science, Information
Science, and Software Engineering, in relation to disruptive technology. The hot topics such as Artificial
Intelligence, Internet of Thing, Blockchain, 5G using Massive MIMO, Wireless Sensor Network, e-Commerse,
etc. will be discussed in 5 sessions and 6 parallel tracks of ICIC 2018.
The ICIC 2018 received a total of 312 submitted papers and each paper went through a thorough reviewing
process to get at least three independent reviews. After a careful and rigorous selected process, we decided
to accept 151 papers for the presentation in the main technical program. The acceptance rate of the paper for
the conference was thus 50%. The paper presentations are organized into 30 sessions in total, on the 17-18
Oktober 2018. On top of the regular paper presentations, ICIC 2018 also features three keynote speeches
delivered by internationally-renowned researchers: Dr. Gerard Borg from the Australian National University,
Canberra, Australia, Dr. Thomas from Germany, and Prof. Dr. Zainal. A. Hasibuan from University of
Indonesia, who is also the Chair of APTIKOM.
ICIC 2018 attrack researchers from 15 countries as authors and reviewers. i.e. Australia, France, Germany,
Greece, India, Indonesia, Japan, Malaysia, Morocco, Oman, Nigeria, Netherlands, Philippines, Saudi Arabia,
and Sweden. ICIC 2018 has received submisision from 919 authors, and we also supported by 91 reviewers.
As a general chair, I cordially welcome all participants to ICIC 2018. We are blessed to have competent and
dedicated organisers, so I would like to thanks to APTIKOM and Unviersity of Bina Darma as the host of ICIC
2018 and also to 12 co-hosts and co-sponsors from higher education institutions, i.e. Sampoerna University,
STMIK Nusa Mandiri, Universitas BSI, Universitas Budi Luhur, STMIK Bina Insani, Universitas Dian
Nuswantoro, STIKOM Bali, STMIK Dipanegara, Universitas Parahiyangan, Universitas Gunadarma, STMIK
Tasikmalaya, and Universitas Pasundan.
In ICIC 2018, the participants can find new colleagues and new opportunity to make this conference as a
fruitful conference. We trust that all participants will enjoy an intellectual and stimulating discussion during
the conference that allow them to move forward in contributing their research work to the body of knowledge
in Computer Engineering, Computing Science, Information Science, and Software Engineering.
Thank you.

Prof. Dr. Teddy Mantoro, SMIEEE

(General Chair of ICIC-2018)
 Technical Sessions Schedule
Technical Sessions ICIC 2018
17-Oct-18
PID Title

TS-1 1 114 Texture Feature Extraction Based On GLCM and DWT for Beef
Tenderness Classification
10:30- 119 Data Mining Classification of Intelligence Quotient in High School
12:00 Students
Session 134 Feature Extraction Using Histogram of Oriented Gradient and Hu
Chair: Invariant Moment for Face Recognition
Prihandoko
148 Deep Learning Long-Short Term Memory for Indonesian Speech
Digit Recognition using LPC and MFCC Feature
152 Development Of Heartbeat Measures And Arrythmia Premonitory
Based on Time Sampling
2 280 Educational Data Mining (EDM) as a Model For Students’s
Evaluation in Learning Environment
289 Critical Success Factors for Project Management Office: an Insight
from Indonesia
Session 293 Webuse Usability Testing for Farmer and Farmer Group Data
Chair: Collection System
Suryono
296 Comparison of Two Methods Between TOPSIS and MAUT In
Determining BIDIKMISI Scholarship
301 Evaluation of User Engagement in E-learning Standardization and
Conformity Assessment Using Subjective and Objective
Measurement
3 236 Integration of Region-based Open Data Using Semantic Web

173 Cloud-based e-Business Framework for Small and Medium

Session Enterprises: Literature Review
Chair: 180 Usability Evaluation and Development of a University Staff Website
Teddy
Mantoro
183 The Ontology of SMEs’s Form Application for Interoperability
Systems
191 Customer Awareness towards Digital Certificate on E-Commerce:
Does It Affect Purchase Decision?
 4 213 Comparative Evaluation of Object Tracking with Background
Subtraction Methods
225 Peripapillary Atrophy Detection in Fundus Images Based on Sector
Session With Scan Lines Approach
Chair: 227 Drivers' visual search behaviour: Eye tracking analysis approach
TB. (Case study: on Ir. H. Juanda Street Depok)
Maulana
246 The Generalized Learning Vector Quantization Model to Recognize
Indonesian Sign Language (BISINDO)
250 Algorithm for Simple Sentence Identification in Bahasa Indonesia

5 3 Template Matching Algorithm For Noise Detection in Cargo

Container
22 Genetic Algorithm Modification Of Mutation Operators In Max One
Session Problem
Chair: 24 Meme Opinion Categorization by Using Optical Character
Eri Prasetyo Recognition (OCR) and Naïve Bayes Algorithm
79 Improving Naïve Bayes in Sentiment Analysis For Hotel Industry in
Indonesia
109 Early Identification of Leaf Stain Disease in Sugar Cane Plants Using
Speeded-Up Method Robust Features
6 188 Design of Orchid Monitoring System Based on IoT

190 Remote Sensing System of Odometry and Telemetry data in Real-

Session Time
Chair: 199 Framework for Identifying Agent’s Role in Multi-agent Based Self-
Amil Ilham healing System
207 Fuzzy Rule-Based System for Monitoring Traffic Congestion using
Technology Radio Frequency Identification
209 Prediction of Smarthphone Charging using K-Nearest Neighbor
Machine Learning

TS-2 1 179 Comparison of Color Constancy Approaches on Images with

Unbalanced Color Distribution
14:15- 203 Real-time Recognition and Information Extraction on C++ Syntax
15:55 Session with Augmented Reality
Chair: 243 Performance Analysis of Big Data Frameworks on Virtualized
Ayu Clusters
Purwarianti
244 Fuzzy Kernel Robust Clustering for Anomaly based Intrusion
Detection
 247 Segmentation of Overlapping Areas on Pap Smear Images with
Color Features Using K-Means and Otsu Methods
2 223 Hybrid CPU and GPU Computation to Detect Lung Nodule in
Computed Tomography Images
239 Clustering Grey-Scale Face-Images Using Modified Adaptive Affinity
Propagation with a New Modeled Preference
Session 245 Optimizing Marshall Test Parameters on Asphalt Concrete Using
Chair: Hybrid Neural Network - Genetic Algorithm Approach
A. Benny
252 An Initial Study to Solve Imbalance Sundanese Handwritten Dataset
Mutiara
in Character Recognition
254 Classification of Personality Type By Typology Hippocrates - Galenus
Using Naïvebayes Algorithm and Naïvebayes Decision Tree
Algorithm
3 210 An Adaptive e-Learning Model Based on Myers-Briggs Type
Indicator (MBTI)
241 Determinant factors of new investor intention for using online
Session trading system
Chair: 283 Comparative Analysis of Multi-Criteria Decision Making for Student
Betty Degree Completion Time based on Entropy Weighted
Purwandari
302 Global Software Development and Capability Maturity Model
Integration: a Systematic Literature Review
305 Influence Blended Learning on Learning Result of Algorithm and
Programming
4 45 Filtering Impolite Words in Social Network Using Naïve Bayes
Classifier
49 Comparing CART and C5.0 Algorithm Performance of Human
Session Development Index
Chair: 91 The Modeling of Artificial Neural Network of Early Diagnosis for
Rahmadya Malnutrition with Backpropagation Method
107 Mel-frequency Cepstral Coefficient-Vector Quantization
Implementation for Voice Detection of Rice-Eating Birds in The Rice
Fields
162 Students’ Academic Performance Prediction using Data Mining

5 171 Comparison of Job Position Based Promotion Using: VIKOR,

ELECTRE And Promethee Method
226 Symmetric Key Distribution Model Using RSA-CRT Method
Session
Chair: 271 Identifying and Validating Components for National Cyber Security
Opim Salim Framework
 272 Hybrid RC4 and Affine Ciphers to Secure Short Message Service on
Android
300 Verifying Authenticity of Digital Certificate and Transcript Using
Background Subtraction Method
6 268 Analysis Similarity of Taekwondo Movement Using Data Motion

270 S-box Construction of Highly Strict Avalanche Criterion Using

Algebraic Technique
Session 288 Experiments on Character and Word Level Features for Text
Chair: Classification Using Deep Neural Network
Riri Satria
299 Utilization of Semantic Web Rule Language for Tourism Ontology

304 Neural Network with Support Vector Regression for Land-Use

Growth Prediction

TS-3 1 65 Quran Tajweed Extraction and Segmentation Based on HSV Color

Space Model
16:15- 73 Digital Image Analysis of Beef Color Using Euclidean Distance
17:50 Session Method
Chair: 108 Android-Based Text Recognition on Receipt Bill for Tax Sampling
Suryono System
147 Hardware Based Artificial Neural Networks for Basic Pattern
Recognition Application
256 SPOT: A Low Cost Intelligent Parking System for Urban Malls

2 38 Prediction the Crime Motorcycles of Theft using ARIMAX-TFM with

Single Input
112 Steganography with Highly Random Linear Congruential Generator
Session for Security Enhancement
Chair: 136 Expert Mapping Development System with Disease Searching
Prihandoko Sympthom Based on ICD 10
151 Comparing SAW and AHP Decision Support Methods for Disease
Analysis in Indonesia

3 228 B2C Website Quality Criteria Analysis: A Case of 5-Star Hotel

240 Information Technology Governance Profile of E-Government

Session 267 Analysis the Acceptance of Use for Document Management System
Chair: Using Technology Acceptance Model
Media A. 282 Adoption Factors of e-Government Services in Indonesia
Ayu
307 Prototyping Web Based Information System of Animal Strategic
Spreading Disease Using Kano Models
4 145 Literature review on Artificial Neural Networks Techniques
Application for Stock Market Prediction and as Decision Support
Tools
Session 168 Classification of Indonesian Government Budget Appropriations or
Chair: Outlays for Research and Development (GBAORD) Using Decision
Doni Tree and Naive Bayes
Purnama 176 The Pedagogy Optimization with Educational Data Mining and
Learning Analytics for E-Learning System – A Review of the
Literature Review
61 Batik Motif Identification with Gray Level Co-Occurrence Matrix and
Artificial Neural Network Backpropagation
175 Customer Segmentation based on RFM model and Clustering
Techniques With K-Means Algorithm
5 2 Redesigning CHIML: Orchestration Language for Chimera-
Framework
139 Performance Analysis of Information Quality Indexing in
Session Government Agency’s Social Media: a case of Customs in Indonesia
Chair: 141 Development of Banten E-Heritage using Virtual Reality Technology
Dwiza on Mobile Device
Riana
178 Preprocessing For Crawler Of Short Message Social Media

237 Toward Immersive Mobile Multimedia: From Mobile Video to

Mobile Extended Reality
6 273 Classification Default of Credit Card Clients Using LS-SVM Ensemble

274 Classification for Multiformat Object of Cultural Heritage using

Session Deep Learning
Chair: 291 Spellchecker Improvement on Stemmer Algorithm for Indonesian
TB. Language
Maulana
303 Cluster Analysis of Indonesian Province Based on Prices of Several
Basic Food Commodities
 18-Oct-18
TS-4 1 216 Primary Care Functional Requirements of a Health Information
System in Indonesia
07:50- 312 The Digital Company Based on Competitive Strategy
09:40 Session
Chair: 286 Group Decision Support System to Selection Tourism Object in Bali
Lintang Using Analytic Hierarchy Process (AHP) and Copeland Score Model
Banowosari
78 Comparative Analysis Between Online E-Learning and Face to Face
Learning: An Experimental Study
269 Bioinformatics Resource Portal

2 259 Mobile Measurement System of Ozone Concentration in Urban

Areas
249 A Review: Contrast-Limited Adaptive Histogram Equalization
Session (CLAHE) methods to help the application of face recognition
Chair: 166 Genetic Algorithms with Variable Length Chromosomes for High
Amil Ilham Constraint Problems in Spatial Data
195 Heading Correction in Rocket Flight System Using Odometry
Trajectory Information

3 117 Implementation of Green IT In Education Industries

142 Change Management Methodology for e-Government Project in

Session Developing Countries: a Conceptual Model
Chair: 159 Foreign Direct Investment (FDI) and Information Communication
Husni Teja and Technology (ICT) Perspective: Empirical Study In Asia
200 The Ontology of IT Service Management by Using ITILv.3
Framework: A Case Study for Incident Management
208 Technology-enhanced Learning Maturity Model: Component and
Characteristics Analysis
4 156 Review of the Recent Research on Automatic Text Summarization in
Bahasa Indonesia
164 Saving The Vegetable Peddler (Mlijo) with Information Technology
Session
Chair: 189 Automatic Time-based Learning Type Analysis towards Dynamic
Cecilia Personalization
Nugraheni
193 Automatic Comparison of Products based on Opinion Features
using Synonym and Jaccard Similarity
 5 229 The AlKesFar App, A Mobile Augmented Reality on Learning Media
Tools for Indonesian Pharmacy School
232 Application Control and Monitoring of Light Usage in Smart Home
Session Environment
Chair: 234 Predicting Grade Promotion Using Decision Tree and Naïve Bayes
Nur Sultan Classification Algorithms
S
50 Speech Command for Automatic Sluice Gate Based on MFCC and
Deep Neural Networks
161 Secure Smart Card Reader for University Presence System

6 196 A Proposed Crowdsourcing Engine for Indonesian Cultural Heritage

242 Prototype Of Feeding Devices ,Temperatures And Humidity

Monitoring At Broiler Chickens Breeders With The Internet Of
Session Things Concept
Chair: 298 Data Comparison of NFC PN532 on Wemos D1 and MKR1000 Board
Eri Prasetyo through MQTT Protocol
306 Application Development Based on Mobile Learning Framework on
Rice and Vegetable Agriculture

TS-5 1 146 Developing a QR Code-based Library Management System with

Case Study of Private School in Surakarta City Indonesia
10.55- 153 Safe Distance Detector to Watching Television
12.40 Session
Chair: 198 Term Frequency Method For Automated Text Summarization
Prihandoko Application Of Indonesian News Article
297 Security Scheme for Medical Images Based on Dual-Layer Fragile
Watermarking

2 186 Development of a website-based decision tree system in data

mining concept
221 Robotic Arm of Goods Sorter in Factory Based on Color Using
TCS3200 Sensor With Monitoring System Based on Web
Session 253 The Physical and Engineering Requirements of Scalable,
Chair: Decentralised, Distributed, Large-Scale MIMO
A. Benny 264 Data Processing Architecture using Open source Bigdata
Mutiara Technology to Increase Transaction Speed

3 103 Assessment of Teacher Performance Using Technique For Other

Preference By Similarity To Ideal Solution (TOPSIS)
138 Identifying The Relevant Indexed Term Related with The Book
Session Domain Using Semantic Relatedness Approach
Chair: 149 Detecting Learning Style Based on Level of Knowledge
A. Nizar H.
157 Visual Based Path Detection for Obstacle Avoidance

4 111 User Experience Measurement On Go-Jek Mobile App In Malang

City
169 Modelling of Schools ICT Utilisation: An Empirical Study in Indonesia
Session
Chair: 206 Challenges and Issues of E-Participation Implementation: A Case
Betty Study of E-Complaint Indonesia
Purwandari
231 Comparison Method Topsis Saw and in The Selection of Attractions
in Indonesia

5 258 The Evaluation of Web Based Academic Progress Information

System Using Heuristic Evaluation and User Experience
Questionnaire (UEQ)
167 An Integrated Business Intelligence and Visualization Framework to
Session Investigate Factors Influencing Customer’s Engagement on
Chair: Instagram Contents: A Lesson Learned from a Local Instagram
Suryono Business Account in Indonesia
155 Measurement of Employee Information Security Awareness: Case
Study At The Directorate General of Resources Management and
Postal and Information Technology Equipment Ministry of
Communications and Information Technology
163 A Collaborative Process Scheme in Strategic Information Systems
Planning
6 40 Comparative Analysis of Test Automation Framework Performance
for Functional Testing in Android-Based Applications Using The
Distance To The Ideal Alternative Method
99 Software Verification and Validation on Object Oriented Software
Session Development using Traceability Matrix
Chair: 165 The Design Of IT Development Based On EA Model For Islamic
Opim Salim Boarding School
292 Revealed-Preference Activity Rule in Combinatorial Clock Spectrum
Auction: A Review and New Research Opportunities
 Host of ICIC 2018

Co-Hosts of ICIC 2018

 Evaluation of User Engagement in E-Learning
Standardization and Conformity Assessment Using
Subjective and Objective Measurement
Lintang Yuniar Banowosari Komang Anom Budi Utama
Information Management Information System
Gunadarma University Gunadarma University
Depok, Indonesia Depok, Indonesia
[email protected] [email protected]

Abstract - Based on Article 56 Act No. 20 of 2014 come face to face directly although his place far from each
concerning Standardization and Conformity Assessment; other. While asynchronous is student can access materials
BSN and an expert team developed an e-learning provided either in the form of text or multimedia every day
Standardization and Conformity Assessment (E-learning (24 hours/7 days) and can also be accessed anywhere. In
Standardisasi dan Penilaian Kesesuaian). User order to make implementation of e-learning can run as
engagement is the quality of the user experience (UX) that expected, at least have three fundamental building blocks of
stresses the positive aspects of the interaction, and e-learning as follows [1]: E-learning infrastructure, Systems
especially the occurence related with being attracted by a and e-learning applications, and E-learning Content.
web application, and so being encouraged to use it. Besides the forming components, the readiness of
Successful web applications are not just used, they are users in utilizing e-learning should also be considered.
engaged with. In this research, there are a number of When using e-learning, students are required to be able to
variables that are used to evaluate user engagement in e- learn by itself (self-learning). But in the fact, most of the
learning Standardization and Conformity Assessment. student depended on the instructor. According to the study
Those variables are Task Success, Novelty, Aesthetics, in year 2000 conducted by Forrester Group to 40 large
Happiness, and Endurability which measured subjectively companies, showed that most workers (over 68%) refused to
and objectively. The assessment results showed that both participate in training that uses the concept of e-learning.
of these measurements produce different results. All When e-learning was required of them, 30% refused to
variables were assessed subjectively indicate that e- follow [2].
learning Standardization and Conformity Assessment have Study about engagement, that engaging interactions
a good engagement, but from an objective measurement take place throughout or following user uses computer
only variable task success which has a good engagement. system or applications is interesting. To recognize users’
The other variable has a quite engagement. views, actions, and behaviour about how to create a system
functional and instinctive to use, it has to focus on notion
Keywords - Evaluation, User Engagement, E-learning,
how to develop a particular systems more engaging. There
Subjective Measurement, Objective Measurement
are several ways to measure user engagement including the
use of subjective and objective measurement. Subjective
I. INTRODUCTION measures are based on the users’ perceptions, while
objective measure based on users’ behavior when using the
Nowadays role of standardization is become
application. So it can be made problem definition for this
increasingly recognized, especially in the era of study that is “How is the user engagement in e-learning of
regionalization or economic integration. For example, the Standardization and Conformity Assessment when
ASEAN Economic Community (Masyarakat Ekonomi
evaluated using subjective and objective measurement?”
ASEAN - MEA) 2015. Therefore the competence
This paper consist of five (5) sections, starts with
standardization is become increasingly important to be
introduction which explained the motivation, background
owned by the community, especially the labor/professional.
and problem definition, followed by literature review that
But, based on survey results of perception level on 2013 and related with this research, the third section depict the
2014, public awareness of standardization in Indonesia is research method, the fourth section is about result and
low i.e. 67.67% - 72%.
discussion and the last section conclude the work.
To resolve the problem, then BSN made an online
learning portal (e learning) concerning in Standardization
and Conformity Assessment. The method used in the II. LITERATURE REVIEW
implementation of e-learning adapted to its function.
Function of e-learning Standardization and Conformity
A. User Engagement
Assessment is as a substitute (replacement), because the
learning activity is done entirely using internet, so the
User engagement is a main construct in designing
delivery methods of teaching materials that are used can be
user-centered web applications. It point to the quality of the
both of synchronous and asynchronous. Synchronous is by
user experience that stresses the positive aspects of the
utilizing teleconference, where teachers and students can

XXX-X-XXXX-XXXX-X/XX/$XX.00 ©20XX IEEE

interaction, and especially the occurence related with being users when using a product [5]. While the method of
attracted by technology. This definition is drived by the PULSE is an acronym of five components of itself that are
review that successful technologies are not just used, but page views, up-time, latency, seven-day active users, and
they are engaged with. earnings so it can be used to measure the technical aspects
of the products.
By identifying emotional, cognitive, and behavioral
factors, it stresses the holistic nature of user engagement and In 2010, O’Brien & Toms doing research to find
is also suggestive of feature that available to measurement. instruments that can be used to measure user engagement.
It also points evenly to user engagement in terms of a single Instrument examined, i.e. focused attention, perceived
session or a more long-term relationship across multiple usability, aesthetics, endurability, novelty, and involvement.
sessions. User engagement with a technological resource is All the instrument used to measure user engagement in
not just about how single interactions evolve, but about how online shopping environments. Summary of related research
and why people develop a relationship with technology and can be seen in Table 2.2.
integrate it into their lives.
Table 2.2: Related Research

B. Engagement Measurement

Since user engagement is multi-aspect, there are

plentiful approaches to its measurement. User experience
evaluation metrics consist of two broad types: subjective
and objective. Subjective measures record a user’s
perception, generally self-reported, of the media at hand.
While objective measurement include independent measures
such as the passage of time or number of mouse clicks to
complete a task.

Table 2.1: Subjective and Objective Measurement

c. Related Works

There are several methods that can be used to examine

UX on a product, one of them is User Experience
Questionnaire (UEQ) method. This method has been used to
measure SCELE which is an e-learning provided by the
Faculty of Computer Science at University of Indonesia [3].
This method uses a questionnaire to gather feedback from
users when using a product. The reason why choose
questionnaire to collect the data, because questionnaire more
effective to analyze. UEQ arranged in order to produce a III. RESEARCH METHOD
research or testing effective and less time consuming. By
using UEQ, users must answered questions quickly and A. The Research Steps
spontaneously, thus making the question with profound
material and cause abstract statements about the product Figure 3.1 show steps in this research. It describes the steps
should be avoided. Selection the UEQ question is very carried out from the beginning until finish. Here is an
simple and can be answered as soon as possible by the user. explanation of the steps in this research:

HEART method is a measurement method developed 1. This research is begin by conducted the pretest to
by Google UX. This method has been used to measure the the 15 respondents. Pretest is used to known the
user experience in the use of Academic Information System validity and reliability from statements that
that combined the HEART method with PULSE method [4]. contained in the questionnaire. The statements that
HEART method is an acronym for five components of itself not valid and reliable will be eliminated.
are happiness, engagement, attitude, retention, and task
success so this method can be used to measure emotion
 Table 3.1: Variables and Indicators Used in This Study

Figure 3.1: Research Methodology

IV. RESULT AND DISCUSSION
2. After pretest, it continued with data collection.
Source of data collected in this research consisted Table 4.1 is summary of the user engagement
into two types, namely primary data and secondary assessment results in e learning Standardization and
data. The primary data collected using Conformity Assessment using subjective and objective
questionnaire, while the secondary data collected measurement. From the five variables assessed, only
using google analytics. variable task success which has result of subjective and
3. The next step was process the data that has been objective were not much different.
collected. The data will be measured by subjective
and objective measurements. Subjective Table 4.1: Summary of The Assessment Result
measurement is based on data from questionnaires Variables Subjective Objective
distributed to the respondents, whereas the Task Success 64.6% 65.78%
objective measurements performed by the Novelty 68.67% 42.5%
respondent activity data obtained from google Aesthetics 71.42% 41.58%
analytics. Subjective measurements used to Happiness 68% 40.59%
calculate the descriptive mean and determination of Endurability 67.75% 47.61%
interval and interpretation score. Objective
measurement used to assess the interaction index, A. Task Success
recency index, click index and duration index.
4. The results of assessment using subjective and The assessment of variable task success has not much
objective measurement will be discussed. different between the subjective and objective. Table 4.1 is
5. After that, the discussion result will be used to shown that the result of subjective assessment is 64.6%,
make conclusion. while the objective assessment is 65.78%. Both of these
assessments included into good category.
B. Research Indicators The subjective measurement describe that user has a
high confidence when using e learning Standardization and
This research has five variables. Each variable will Conformity Assessment does not require a lot of resources
be made into several indicators. The indicators are used as (e.g. cost and energy) to do the learning. It can be lead due
an assessment of both the subjective and objective to e-learning technologies take as a lot transformation to
measurement. Explanation of variables and indicators used instructors as they do to students, again involving a new set
in this study can be seen in Table 3.1. of skills for success [6]. In the e-learning athmosphere,
instructors turn from being the primary source of students’
knowledge to being the manager of the students’ knowledge
resources [7]. As Illustration, in a conventional classroom
scenario, the instructor delivers the content to the class and
responds to their questions. In contrast, in a technology only
asynchronous e-learning environment, the instructor is more
of a coordinator of the content, which students then inspect
at their own pace [8]. So, by using e-learning users do not
need to spend money and energy to come into a classroom
to get learning materials.

Beside that, users also feel confident after using e-

learning will increased the understanding of standardization
and conformity assessment, but the availability of e-learning
when needed by the user also must be noticed such as never
crashes or not responding. Based on the user response it is
quite influential factors to increase the value of user
engagement on variable task success. Task Success category
covers several conventional behavioral metrics of user Figure 4.1: News Page of E-learning Standardization and
experience, such as efficiency (e.g. time to complete a task), Conformity Assessment
effectiveness (e.g. percent of tasks completed), and error
rate. The news page that can be seen in Figure 4.1 showed
that the latest news of e-learning Standardization and
B. Novelty Conformity Assessment was published on May 1st 2016. It
means there is no news updates for 4 months. Beside that,
Variable novelty has different assessment result on the course material also didn’t give an update. Based on
subjective and objective. Table 4.1 showed that the value of materials packed in the video which uploaded in youtube, all
subjective assessment is 68.67% which included into the of them publish on July 29th 2015. It showed no addition on
good engage category. While the value of objective the course material for 1 year. If observed on these facts, the
assessment based on the level of returns users to access e- difference between objective and subjective assessment
learning Standardization and Conformity Assessment is could have been caused by the perception that users expect
42.5% which included into the quite engage category. not supported by the services provided in e-learning
Standardization and Conformity Assessment. Whereas the
Based on the results of user responses, it can be seen more recently a customer has done something, the more
that users feel interested and have a high curiosity to the likely they are to do it again.
content available on e-learning Standardization and
Conformity Assessment. Presentation materials are C. Aesthetics
packaged in a flip book and video also makes users assess
this feature is quite innovative, but from the results of Table 4.1 showed the results of subjective
accessing e-learning Standardization and Conformity assessment on aesthetics variable is 71.42% which is
Assessment conducted on September 16th 2016, it obtained included into the good engage categories, while the
the fact that the content provided is rarely experienced an objective assessment is 41.58% which included into quite
updating. engage category. Results of objective assessment obtained
from the number of click index per session that conducted to
In e-book of 98 tips to skyrocket sales through the 40 users.
website, the website content and design is the key to make
the visitors make a transaction. Therefore, it is important to Based on the results of users’ responses, it can be
update the website content such as published articles or seen that users have a high assessment on aesthetics design,
upload the latest product, because updating the website so it can make users recognize e-learning Standardization
content regularly is a reflection of how professional a and Conformity Assessment of the initial interface and make
website. Beside that, the following are factors that affect the easily understand the features contained in it. Users also
importance of updating the website content regularly [9]: give a high assessment that the layout is very comfortable to
A. Updating website content regularly is a great way look. But, there is a low assessment that the interface design
to improve SEO of website or online store. was not attractive.
B. As a tools to communicate with website visitors
and customers who frequently shop at the online There are 7 ways to create attractive user interfaces [10]:
store. 1. Follow Hick’s law (don’t disorder interfaces)
C. Make website or online store more professional. 2. Use the right signifiers
D. Improving the skills and knowledge to serve 3. Know which colours evoke which moods
customers. 4. Understand and apply the different types of
symmetry
5. Use photos of real people
6. Maintain consistency
7. Take advantage of white space
 The small value of click index in the objective to family and friends to join using it, because these factors
assessment could be caused by lack content provided in e- have a quite influence assessment.
learning Standardization and Conformity Assessment. So, to
increase the value of click index can be enhanced by [11]: To increase the level of engagement in objective
1. Improve Website Content side, it must increase the factor of recency index, click
2. Refocus Keywords index, and duration index due to e-learning Standardization
and Conformity Assessment have a low assessment on those
D. Happiness factors.

Variable happiness has different assessment result on V. CONCLUSION

subjective and objective. Table 4.1 showed that the value of
subjective assessment is 68% which included into the good Based on the results of the assessment has been done,
engage category. While the value of objective assessment both of these measurements produce different results. All
based on the duration while access e-learning variables were assessed subjectively indicate that e-learning
Standardization and Conformity Assessment is 40.59% Standardization and Conformity Assessment have a good
which included into the quite engage category. engagement, but from an objective measurement only
variable task success which has a good engagement. The
Users often forsake web pages in 10-20 seconds, but other variables have a quite engage. Based on these results,
pages with an obvious and understandable value proposition it can be concluded that the difference between subjective
can keep people’s interest for more extensive. So, it is and objective assessment could have been caused by:
important to pay attention to the clear value proposition, 1. The perception that users expect not supported by
since visit-durations follow a negative Weibull distribution the services and performence provided in e-
[12]. Negative aging is theory that the longer the element learning Standardization and Conformity
has been in service, the less possibly it is to collapse. Here, Assessment.
the risk function decreases for larger values of time. This 2. There is no policy that requires users to use and
makes sense when individual elements vary in quality: continue to use elearning Stadardization and
poorly created elements usually collapse early, so anything Conformity Assessment, so in the future users can
that has been in service for a long time is possibly to be freely determine will use this e-learning again or
particularly robust and will usually survive even longer. not.

Based on the results of the subjective measurements, To improve the level of users’ engagement in e-
when using e-learning Standardization and Conformity learning Standardization and Conformity Assessment, one
Assessment users do not feel depressed and scared to of the most obvious is by always updating the content
operate the features contained in it, because users feel quite contained on it regularly. So users will curious and return to
happy and proud after using e-learning Standardization and access this site again. In addition, for the further research
Conformity Assessment. In addition there are factors that about evaluation of user engagement, can be added other
must be noticed, i.e. when using the e-learning variables or by applying the same variable in this research
Standardization and Conformity Assessment, users also feel and try it with different research objects.
quite nervous.

In e-learning Standardization and Conformity REFERENCES

Assessment, there are exams to get a certificate. The
nervous factor could have emerged from here. This factor is [1] Wahono, R. S. (2008). [online] available at:
usually called with test anxiety which is an anxiety of a http://romisatriawahono.net/2008/01/23/meluruskan-
person faces a test or exam [10]. Carlson explains anxiety as salah-kaprahtentang-elearning/. Meluruskan salah
fear and anticipation of bad luck in the future, this anxiety kaprah tentang e-learning. [Accessed 16 July 2016].
has a shadow that no immediate danger in an activity and an [2] Dublin, L. and Cross, J. (2003). Implementing e
object, if someone sees that symptoms then he will feel learning: Getting the most from your e learning
anxious [13]. investment. the ASTD International Conference.
[3] Harry B. Santoso, Martin Schrepp, e. (2016).
E. Endurability Measuring User Experience of the Student-Centered
e-Learning Environment.
Table 4.1 showed the results of subjective [4] Paulus Insap Santosa, Putri Novaninda Lestari, R. F.
assessment on endurability variable is 67.75% which is (2016). [online] available at: https://
included into the good engage categories, while the fti.uajy.ac.id/sentika/publikasi/makalah/2016/53.pdf.
objective assessment is 47.61% which included into quite Pengukuran Pengalaman Pengguna Dalam
engage category. The results of the subjective measurements Menggunakan Sistem Informasi Akademik, 2089-
showed that users have a high willingness to use e-learning 9815. [Accessed 18 July 2016].
Standardization and Conformity Assessment in the future. [5] Rodden, K., H. H. . F. X. (2010). Measuring the User
Factors of user experience must be considered to make user Experience on a Large Scale : UserCentered Metrics
wants to continue using e-learning for learning activities of for Web Applications. Proceedings of the SIGCHI
standardization and conformity assessment and recommend Conference on Human Factors in Computing
 Systems, 2395â2398. [9] Creativebloq (2015). [online] available at:
http://doi.org/10.1145/1753326.1753687. http://www.creativebloq.com/web-design/create-
[5] Jones, A. (2003). ICT and Future Teachers: Are we attractive-userinterfaces-91516600. 7 ways to create
preparing for e-learning? Paper presented at the IFIP attractive user interfaces. [Accessed 2 August 2016].
Working Groups 3.1 and 3.3 Conference: ICT and [10] Fleiss, W. (2014). [online] available at:
the Teacher of the Future. January 27-31, 2003, http://www.outbrain.com/blog/how-to-increase-ctr-
Melbourne, Australia. in-7-easy-steps. How to Increase Your CTR in 7 Easy
[6] Romiszowski, A. (2004). Howâs the e-learning Steps. [Accessed 2 August 2016].
baby? factors leading to success or failure of an [11] Nielsen, J. (2011). [online] available at:
educational technology innovation. Educational https://www.nngroup.com/articles/how-long-do-
Technology, 44 (1):5â27. users-stay-on-webpages/.How Long Do Users Stay
[7] Teo, C.B., . G. R. (2006). A knowledge-driven model on Web Pages? [Accessed 2 August 2016].
to personalize e-learning. ACM Journal of [12] Revilla, L. (2009). Kecemasan Menghadapi Tes (Test
Educational Resources in Computing, 6 (1):1–15. Anxiety) dan Dampaknya Terhadap AktivitasBelajar.
[8] WebPraktis (2015). [online] available at: [13] Carlson, J, S. W. K. H. (1992). Principles of dynamic
https://webpraktis.com/blog/pentingnya-mengupdate- test: The application of a specific model. Learning
konten-websitesecara-berkala.html. Pentingnya and Individual Differences.
Mengupdate Konten Website Secara Berkala.
[Accessed 2 August 2016].