Advances in Social Science, Education and Humanities Research, volume 529

Proceedings of the International Conference on Engineering, Technology

and Social Science (ICONETOS 2020)

Dynamic Monitoring and Assessment for Digital

Transformation in Higher Education
Supriyono1,* Muhamad Faisal2
1,2
Department of Informatics Engineering, Faculty of Science and Technology
Universitas Islam Negeri Maulana Malik Ibrahim, Malang, Indonesia
*
Corresponding author. Email: [email protected]

ABSTRACT
The development of information technology applied to college institutions is experiencing rapid growth. Information
technology can solve problems faced in educational institutions. Universities are increasing the use of information and
digital technologies for improved service, data management, and accurate reporting. Monitoring and assessment are an
essential part of college development. The parameters used in monitoring and assessment use a parameter on the
strategic plan of the college. The comparative study of the strategic plan is targeted at two universities that have
different characteristics, namely public universities and Islamic state universities. The method used in building
dynamic monitoring and assessment uses machine learning. Parameters in monitoring and assessment include Tri
Dharma Higher Education such as research, education, and community development. Based on these problems can be
formulated implementation of dynamic monitoring and assessment for digital transformation in Higher Education as
well as prototype models of dynamic monitoring and assessment based on machine learning. The results obtained
show that parameter testing yields an average of 78%. This indicates that the level of accuracy using machine learning
can implement dynamic monitoring and assessment in digital transformation at higher education.

Keywords: Information Technology, Dynamic Monitoring, Assessment, Machine Learning, Higher

Education.

1. INTRODUCTION management by improving decision-making and will

help prevent unexpected losses caused by faults during
The development of information technology applied the manufacturing process [2].
to institutions of universities is experiencing
considerable development. Along with the era of The development of digital support equipment
industrial revolution 4.0, universities should be able to requires a digital transformation process towards
prepare the next generation of a reliable and resilient universities is the best. So, it is necessary to be the
nation. In scoring qualified graduates, the role of college measurement, full of planning but remain dynamic and
becomes very vital. With the advancement of higher prioritize ecosystem collaboration in the design of
education teaching reforms, more people are paying digital solutions. The development of the industrial
attention to the development of more scientific, revolution era 4.0 makes universities should be able to
intelligent, and effective modern campuses [1]. The make a complete contribution to the implementation of
more measured and targeted the management of digital transformation [3]. In the process of digital
education big data, the better the assessment level in transformation, there is standardization in how people's
universities and vice versa. It was coupled with the data can be protected and utilized. Digital
development of big data analysis techniques, Cloud transformation in universities covers several aspects.
technology, sensors, Internet of Things (IoT) based Dynamic monitoring and assessment that is expected to
sensors, and big data processing systems that are bridge the improvement in the development of digital
sufficiently efficient to monitor the manufacturing transformation in a college [4].
process. Furthermore, using the hybrid prediction model The digitization strategies should include a more
has better fault prediction accuracy than other models comprehensive focus and propose that enterprise
given the sensor data as input. It is expected to support

Copyright © 2021 The Authors. Published by Atlantis Press SARL.

This is an open access article distributed under the CC BY-NC 4.0 license -http://creativecommons.org/licenses/by-nc/4.0/. 1
 Advances in Social Science, Education and Humanities Research, volume 529

architecture management could provide an essential and efficient development of human resources.
contribution in structuring digitization efforts and that Improved service and management at universities can be
enterprise or knowledge portals could play a role in measured by the level of digital transformation
implementing the strategies investigate the dynamics of development. The development of the digital campus
higher education funding and the ensuing impact on can increase the level of efficiency and effectiveness in
part-time teaching, staff to student ratios, staff the management of existing business processes in
development, research productivity, and hence the universities. Based on the problem, the following
perceived quality, using a system dynamics simulation problems can be formulated How is the implementation
model [5]. The model developed is based on higher of dynamic monitoring and assessment for
education literature in the developing world in general transformation digital, and how are the potential
and particular they use the resulting model to review prototype model of dynamic monitoring and assessment
policies on funding and quality in higher education, and use machine learning.
ultimately envisage that the model can easily be adapted
to higher education in other environments [6]. 2. METHODS
Digital transformation in the education sector has This research is a comparative study with data
implied the involvement of sustainable management to collection methods through literature reviews,
adapt to the changes imposed by new technologies. observation, in-depth interviews, and Focus Group
Trends in global research on this topic have been Discussion (FGD). The objects in this research are
analyzed and studied during the 1986–2019 period. A university stakeholders on campus, curriculum and
bibliometric study of 1590 articles from the Scopus education experts, and students.
database has been applied. The results provided data on
the scientific productivity of authors, journals, In more detail, the methods in this study can be
institutions, and countries that contribute to the described as follows:
development of this research area. The evidence reveals
an exponential trend, with a particular interest in the last 2.1. Research Location
five years [7].
The research was conducted in Malang because it has
Digitalization and transition to a new technological some characteristic similarities, both as an educational
structure bring humanity to another level of city, with multicultural populations of different
development. The changing technological structures, ethnicities, religions, and backgrounds. Also, these
industry, and social progress enhance the importance of regions have become one of the areas used by
improving the university development model. The Information Communication and Technology.
existing management system and infrastructure in
universities are often outdated and unable to ensure their 2.2. The Subject of Research
competitive and adequate functioning. Hence, the need
to improve the processes of using the university Institutionally, this research subjects consist of
infrastructure through digital technology. The Brawijaya University Malang and State Islamic
composition and range of the resources should also be University of Maulana Malik Ibrahim Malang.
reviewed and supplemented with new components. the
recommendations formulated to improve the university 2.3. Data Collection
infrastructure using digital technology will make higher
education more effective [8]. Lecturer in Indonesia has In data collection, the following methods will be used:
three activities that must be done, including teaching,
research, and community service. Qualified lecturers not 2.3.1. Participative Observation
only fulfil these three obligations but also work and are
more skilled in each of these points. In every point Researchers will make observations at the location
contained in the Tridharma of higher education, as by reviewing the implementation of dynamic
educators, it is also required to face digital monitoring and assessment to mapping the potential for
transformation where teaching and learning, face-to- the development of model and prototype dynamic
face teaching and learning can be equal or more monitoring and assessment.
effective by utilizing digital technology to be more
flexible. The use of digital technology can make 2.3.2. In-depth Interview
teaching and learning more flexible and lead to
improved student skills in learning [9]. In the data collection process, researchers will
conduct in-depth interviews with university
Universities must be ready for digital stakeholders, education experts, and students regarding
transformation, especially in the covid-19 pandemic. the implementation of dynamic monitoring and
Universities need to improve the productive, effective,

2
 Advances in Social Science, Education and Humanities Research, volume 529

assessment and the possible chance to develop dynamic

monitoring and assessment in higher university.

2.3.3. Literature Reviews

Researchers will collect various references related to
dynamic monitoring and assessment in higher
university.

2.3.4. Focus Group Discussion (FGD)

FGDs will be held to enrich the data obtained
through the previous methods.

2.3.5. Data Analyze Method

The collected data will be compiled for reduction, Figure 1 Monitoring and Assessment Based on
display, verification, and conclusion. As a tool for Machine Learning
carrying out this process, the researcher will use Machine Learning Based On Assessment and
machine learning. The data that has been collected will Monitoring, and Visualization.
be coded, and cases will be created. Furthermore, it will
be studied through the creation of matrix frameworks a. User Input Data, Collect Data, Recording
and clustering. The parameters for monitoring and The user enters the parameters used in the
assessment of digital transformation in higher education following research. The parameters used include
are as follows. the strategic plan of the research object. Strategic
plan used from the University of Brawijaya and
a. Organization and strategy
State Islamic University of Maulana Malik Ibrahim
The Organization and strategy section include Malang. The difference between the two
strategic plans developed in universities, both short universities in terms of scientific integration
and long term. because at State Islamic University of Maulana
b. IT Capabilities Malik Ibrahim, there is the integration of science
This section includes IT skills, IT infrastructure, IT and Islam and vice versa at the University of
organizations, and IT security issues. Brawijaya only applies the scientific side of the
general field.
c. Digital Academic Processes
This discussion includes student registration, b. Extract and Upload Data
academic or course management, scheduling, and The parameters used are extracted data in the form
student activity management. of special encoding. The next step is to upload the
data and extract the data thoroughly using certain
d. Digital Research and Transfer tools.
The following sections cover research proposal
submission, review, reporting, management of data c. Data Cluster, Data Cleaning
generated in research. Parameter grouping is done by determining the
likeness of each data. Every public and private
e. Digital infrastructure and resource management college implements Tri Dharma Higher Education.
This discussion includes human resource The Tri Dharma element of universities is grouped
management, campus infrastructure management, according to the specified cluster.
and inventory management.
d. Clustered Index
f. Digital marketing and relationship management The grouping of test data used is aimed at
This discussion includes tracer study, research facilitating the identification of the parameters
partners, academic partners, companies for the used. Indexing is done based on a previously
internship, website quality. defined code.
The methodology of this research is shown as shown e. Process Data for Machine Learning Based on
in Figure 1, which consists of User Input Data, Collect Assessment
Data, Recording, Extract and Upload Data, Data The assessment made from both parameters is
Cluster, Data Cleaning, Clustered Index, Process Data carried out thoroughly based on each test data that
for Machine Learning Based On Assessment, Process has been determined. The test results are carried
Data for Machine Learning Based On Assessment, out sequentially according to the necessary needs.

3
 Advances in Social Science, Education and Humanities Research, volume 529

f. Machine Learning Based on Assessment and Islamic civilization as a step to implement the teachings
Monitoring of Islam as a mercy for the universe. Therefore, future
The method used in the monitoring and assessment development needs to be directed to regional recognition
process is based on the results of tests based on and reputation with autonomous status (PTN-BH). Based
machine learning. on the direction of this development, State Islamic
University of Maulana Malik Ibrahim Malang has high
g. Visualization competitiveness and can compete healthily with other
Recommended results from tests conducted based universities in the world. Efforts to get to the University
on the use of identified parameters. Dynamic with Regional Recognition and Reputation.
monitoring and assessment are based on using a The indicators achieved at the International
machine learning approach. Visualization results Recognition and Reputation stage are as follows.
can be shown that assessment and monitoring 1. Modern campus with Islamic leadership and
parameters can degenerate automatically when governance system international recognition
determining the type of college selected. 2. An infrastructure capable of carrying out various
academic and non-academic activities and
3. RESULTS AND DISCUSSION international services on land above 100 Ha
3. The Mahad system is to be occupied by Indonesian
The parameters performed from both research objects students, and cross-border countries with a
can be indicated by the identification of the parameter distinctive and measurable Islamic character
used. Table 1 shows the parameters used from both education with the capacity to Ma'had reached 7000
colleges that have different characteristics. State Islamic students
University of Maulana Malik Ibrahim Malang has now 4. Questionable and modern services for the services
become one of the universities with BLU status and was of all stakeholders including cross-border
once promoted by the Ministry of Religion to become a stakeholders
world-class university. Also, to further enhance its role 5. The development of an effective and efficient
in national development has been proclaimed the ideals governance system through accountable, credible,
at State Islamic University of Maulana Malik Ibrahim transparent, responsible, and fair
Malang into the center of excellence and the center of 6. The development of integrated madrassas to

Table 1. Parameters used based on the strategic plan of the Institutional Establishment and Academic Reinforcement
stage at the State Islamic University of Maulana Malik Ibrahim

Code Description
M01 The construction of adequate infrastructure for offices at both the university and faculty level
M02 The construction of adequate infrastructure for ma'had that can accommodate 3000 students
M03 The construction of adequate infrastructure for lecture activities, activities in laboratories, workshops,
and studios
M04 The construction of adequate infrastructure for student activities, body, and art
M05 The awakening of comfortable service rooms
M06 The awakening of a good governance system throughout the university
M07 Establishment of a credible, accountable, effective, based on a strong culture derived from Islamic
values
M08 Establishment of a reliable leadership and management system
M09 The realization of curriculum that leads to the vision, has competence and have the right body of
knowledge
M10 The establishment of a well-organized academic system in learning, research and community service
M11 The growth of academic atmosphere and declining political nuance throughout the university
M12 The realization of information systems based on Information Technology
M13 Study programs accredited by BAN-PT
M14 Internationalizing institutions and courses
M15 Building a Curriculum that has international competencies with peculiarities integration of science
and Islam as evidenced by a review of curriculum experts on in higher education ranked below 1000
webometric versions

4
 Advances in Social Science, Education and Humanities Research, volume 529

international standard madrassas 2022 needs to be carried out internationalization

7. Proper and fair remuneration system with minimum activities of institutions and study programs, build a
income of education personnel 150% of regional curriculum that has international competencies with the
minimum wage Malang city per month peculiarities of the integration of science and Islam, and
8. Cooperation with foreign institutions that are develop various academic and non-academic activities
functional and mutually profitable with foreign institutions. The following parameters are
9. The awakening of a cross-border promotion system used in dynamic assessment and monitoring testing.
through various media and activities planned
promotions The parameters used at the University of Brawijaya
10. The growth of various academic and non-academic are categorized as follows.
activities conducted by UIN Maulana Malik
1. Improving the quality of education
Ibrahim Malang with Foreign institutions
2. Improvement of research quality and
11. The growing number of foreign students from all community service
over the world 3. Improvement of student and alumni quality
12. A growing number of lecturers and educational
4. Improvement of institutional quality and
personnel who can speak English or Arabic are
cooperation
implemented in lectures and services
13. The growth of international classes attended by A. Improving access and equalization of education
cross-border students and taught by 10% to 20% of
1. Improved access and quality of prospective
lecturers from Foreign Universities who have a
students
ranking in under 500 versions of Webometric
2. Improvement of the quality of the study program
14. The development of courses in medical and
3. Opening of a new course
scientific Health
4. Improvement of Student/Lecturer Ratio
15. 80% A accredited Study Program by BAN-PT and
5. Improvement of PBM facilities and
50% accredited by AUN-QA or International
infrastructure
Professional Association
6. Completion of the construction of Education
16. Graduate students make up 50% of all university
Hospital
students
7. Development of UB Campus outside the main
17. The curriculum that has international competencies
campus
with the peculiarities of science integration and
8. Development of UB Campus facilities and
Islam as evidenced by a review of curriculum
infrastructure to Green Campus
experts on similar sciences in colleges rank below
9. Development of airy laboratory infrastructure
500 versions of Webometric
and UB technopark
18. Development of IT-based service systems and e-
10. Improved educational resources and media
learning systems for learning in special fields
11. Improvement of lecturer quality
19. The growth of lecturers who teach/become
12. Development of entrepreneurial education
speakers in universities ranked below 500 versions
13. Vocational education development
of Web metric
14. Strengthening the implementation of KBK
20. The growing number of researches with grants
curriculum with KKNI standard
from Abroad or research presented in scientific
15. Improved competitiveness of graduates
activities at the Universities ranking below 500
16. Improved International Competitiveness
Web metric versions
17. Improved information systems for postgraduate
21. The amount and a study in higher education
academic services
between 10-15% of and a whole in higher
18. Improvement of lecturer quality
education
19. Professor acceleration
22. The growing number of HAKI, especially related to
20. Improved PBM process efficiency
the domain of science integration and Islam
21. Implementation of Remote Education (PJJ)
23. The growth of intellectual activities implemented in
the region national or regional Asia with funding of B. Improving the quality of research and community
at least IDR 10,000,000,000 per year service
24. The growing number of students who can play a
role in jobs International 1. Increased resource capacity for research
25. The amount of funding sourced from PNBP reaches 2. Institutional capacity building
IDR 70,000,000,000 per Year 3. Coaching and Improving the Quality of Research
State Islamic University of Maulana Malik Ibrahim 4. Coaching and Improving the Quality of Research
Malang has established herself towards Regional 5. Development of multi-discipline research with a
Recognition and Reputation in its strategic planning. new paradigm
Based on the study of strategic issues that have been 6. Increased domestic research cooperation
7. Increase in number of Publications
done, so to strengthen the policy at State Islamic
University of Maulana Malik Ibrahim Malang in 2018-

5
 Advances in Social Science, Education and Humanities Research, volume 529

8. Development of accredited national journal Table 2. Result of Optimization

publishers
9. Improved publication quality Parameter Result of Optimalization
10. Increase in international publications
11. Growth and Development of International Level UINM01 – UINM015 4,466666667
Research Center UINN01 – UINN25 4,6
12. Growth and development of international Journal
Publishers UBA01 – UBA21 4,571428571
13. Development of Cooperation with international UBB01 – UBB18 4,555555556
institutions in the field of Research
UBC01 – UBC12 4,583333333
14. Increased value for research
15. Increase in the number of community service UBD01 – UBD13 4,615384615
activities
16. Increase in societal activities
17. Community entrepreneurship development
18. Development of effective science and social 13. Increased international research funding from
review activities international agencies.

C. Improvement of student and alumni quality The parameters used can be shown as follows.
a. UINM01 – UINM015
1. Increase in the number of scholarship students
b. UINN01 – UINN25
2. Improved student achievement
c. UBA01 – UBA21
3. Imaging of student activities internationally
d. UBB01 – UBB18
4. Student career development
e. UBC01 – UBC12
5. Establishment of Student Identity
f. UBD01 – UBD13
6. Improving student innovation and creativity
7. Improvement of student entrepreneurial spirit The results obtained in the study are shown as
8. Improved competitiveness of graduates follows. The parameters in determining to model on
9. Increasing the role of activities in the Dynamic Monitoring and Assessment in both higher
international universities are shown in Figure 2. The measurement
10. Increased student participation in international results are done randomly from the strategic plan at
Professional Associations higher universities.
11. Improvement of student facilities and
infrastructure The following research shows that dynamic
12. Establishment of innovation and creativity of monitoring and assessment based on machine learning
students can model digital transformation in college. The results
obtained from each parameter used in system testing
D. Improvement of institutional quality and
have an average level of optimization in the monitoring
cooperation
and assessment process. In testing, the method showed
1. Improvement of quality and quantity of capacity that it yielded an average of 78%. This indicates that the
2. Increased equalization of higher education accuracy of machine learning usage can implement
opportunities for Community dynamic monitoring and assessment in digital
3. Development of diversity and access to transformation in universities. Future research can add
educational services comparison methods to produce a better level of
4. Increased budget independence from cooperation accuracy.
and business units
5. Development of Entrepreneurial University
supporting services unit
6. Development into a Law University
7. Development of Quality Accreditation of
Institutions
8. Increased Competitiveness at the International
level
9. Increased international cooperation for education
with sister models
10. university in the form of lecturer and/or student
exchange, double degree, sandwich programs, or
other programs that are representative
11. Increased funding from corporate social
responsibility (CSR) companies
12. State-owned enterprises/private enterprises/PMA Figure 2. The Visualization of Result of Optimization

6
 Advances in Social Science, Education and Humanities Research, volume 529

4. CONCLUSION Based Optimization,” IEEE Trans. Cybern., vol.

49, no. 9, pp. 3278–3292, 2019.
The following research uses machine learning in
monitoring and assessment in universities. The [5] P. Matkovic, P. Tumbas, M. Maric, and L.
parameters that have been done are thorough Rakovic, “Digital Transformation of Research
identification of the strategic plan in the college. The Process At Higher Education Institutions,”
results showed that modelling in monitoring and INTED2018 Proc., vol. 1, no. March, pp. 9467–
assessment could be done in higher universities with 9472, 2018.
parameters that have been used capable of producing a [6] K. G. Bakieva and S. K. Muradkasimova,
good level of accuracy. It can be done based on the “Enhancing ICT Technologies in Teaching,
strategic plan set out in the college using machine
Learning and Assessment of foreign languages in
learning. A comparative method is required in
Uzbekistan.,” Int. Conf. Inf. Sci. Commun. Technol.
subsequent research to improve the level of accuracy.
Appl. Trends Oppor. ICISCT 2019, pp. 1–3, 2019.
ACKNOWLEDGMENTS [7] E. Abad-Segura, M. D. González-Zamar, J. C.
Infante-Moro, and G. R. García, “Sustainable
Thanks to the Research and Community Service management of digital transformation in higher
Institute at the Islamic State University of Maulana education: Global research trends,” Sustain., vol.
Malik Ibrahim, who has provided support in research 12, no. 5, 2020.
and publication on research activities.
[8] H. Vargas et al., “Automated assessment and
REFERENCES monitoring support for competency-based
courses,” IEEE Access, vol. 7, pp. 41043–41051,
[1] X. Xu, Y. Wang, and S. Yu, “Teaching 2019.
performance evaluation in smart campus,” IEEE
Access, vol. 6, pp. 77754–77766, 2018. [9] V. Ahmed, K. A. Alnaaj, and S. Saboor, “An
investigation into stakeholders’ perception of smart
[2] M. Mohammadi, A. Al-Fuqaha, S. Sorour, and M. campus criteria: The American University of
Guizani, “Deep learning for IoT big data and Sharjah as a case study,” Sustain., vol. 12, no. 12,
streaming analytics: A survey,” IEEE Commun. 2020.
Surv. Tutorials, vol. 20, no. 4, pp. 2923–2960,
2018. [10] Y. Irawan, S. Muzid, N. Susanti, and R. Setiawan,
“System Testing using Black Box Testing
[3] L. M. Camarinha-Matos, R. Fornasiero, J. Equivalence Partitioning (Case Study at Garbage
Ramezani, and F. Ferrada, “Collaborative Bank Management Information System on Karya
networks: A pillar of digital transformation,” Appl. Sentosa),” pp. 1–7, 2019.
Sci., vol. 9, no. 24, 2019.
[4] S. K. Howell, H. Wicaksono, B. Yuce, K.
McGlinn, and Y. Rezgui, “User Centered Neuro-
Fuzzy Energy Management through Semantic-