Performance Assessment and Evaluation Ofcurving Ma
Performance Assessment and Evaluation Ofcurving Ma
Performance Assessment and Evaluation Ofcurving Ma
Abstract PT. XYZ is a company engaged in manufacturing the defense and security products for military and
commercial, which consists of 20% of military products and 80% of commercial products. This study aims to
determine the performance assessment of the curving machineoperators in PT.XYZ. Previously, the system of
operator's performance assessment has an incomplete criterion that is less likely to reflect actual operator
performance and the absence of reference data for annual bonus sharing. To get an accurate operator
performance, then conducted an assessment based on the Spencer competency owned by each operator. The
dimensions of this assessment are based on objective and subjective judgments. Research data were collected
by observation and filling out the questionnaire.Then, data were analyzed using Expert Choice software. The
method of Analytic Hierarchy Process (AHP) was chosen in accordance with the research problems and
objectives. After obtaining the final result of weight of Analytic Hierarchy Process (AHP), the next
performance assessment was done by integration with Rating Scale method. The results show that there is a
difference in the measurement of performance evaluation of the prior and new method, this is due to
additionalcriteria taken into the new assessment, including absenteeism (presence), quantity of work, work
quality, work safety, teamwork, and so forth.
1.Introduction
Generally, there are three factors or maintain the quality of products to provide
obstacles that often faced by manufacturing satisfactory service for customers. Currently,
companies, including human factor, PT. XYZ has a problem related to the
machine,and environment. Human resource assessment of plant operator performance.
is an important factor that determines the The current performance assessment has
success of achieving the company’s goals, incomplete assessment criteria so that it is
both as the executor and the decision making. less able to reflect the actual operator
Existing human resources must first be performance and the absence of reference
processed and developed so that it can be a data for annual bonus sharing for the operator
potential that supports the development of the with exceeds expectations. Operators with
company, especially in creating skilled and the assessment result of meets expectations,
qualified human resources. Therefore, it is and improvement desired and unsatisfactory
necessary to evaluate the performance of the performance equally get the annual bonus.
company to determine the competence of The assessment is subjective based on the
existing resources. superior's assessment only. In addition,the
PT. XYZ is a company engaged in objectivecriteria arenot described in detail,
manufacturing defense and security products the operating and maintenance criteria, these
for military and commercial purposes, which criteria become general for all machines,
consists of 20% of military products and 80% whereas each machine has different operating
commercial products. In the implementation and maintenance methods. The assessment
of high production, PT. XYZ strives to becomes ambiguous since it is not focused on
the operator's ability to maintain the machine,
* Corresponding author. Email:[email protected] especially when it is specified to a particular
Published online at http://Jemis.ub.ac.id
Copyright ©2018 JTI UB Publishing. All Rights Reserved
machine type. This will affect the
2.Method
The research was conducted at PT.XYZ,
especially in the production department of
the curving machine. This study focused on
the calculation and weighting the competency
criteria and designing the performance
assessment. The investigation will be
obtained on the operators of curving machine
at PT. XYZ, which has the number of 38
operators. The procedures of this research are
described in the following chart at fig. 2.
The variable in this research is Spencer
Competency. This study used 2 types of
questionnaires; questionnaire for determining
the assessment criteria of importance level
and questionnaire for weighting the criteria
by using Analytical Hierarchy Process
(AHP) with pairwise comparison scale.
the quantity of work (0.237), absenteeism expertise is the most important competence
(0.085), and work safety (0.029). and flexibility is the competence with the
3.2.1.2 Weighting the Criteria of Objective lowest interest in assessing operator
Assessment performance.
Subjective measuresinclude 16 of the
Spencer competency, the criterion is 3.2.1.3 Comparison of Objective and
weighted based on the method ofAnalytical Subjective Criteria
Hierarchy Process (AHP) by performing a The Junior Manager of production
pairwise comparison between each criterion department considered that the objective
using the Expert Choice program. measureshave a weight of 0.5 and the
The matrix of pairwise comparison of subjective size has 0.5. The same weight
the subjective measure can be seen in Figure between objective and subjective measuresis
4. It is known that three criteria with the due to both sizes having the same importance
greatest weight are Expertise, Customer in assessing one's performance. The method
Service Orientation, and Organizational of Analytical Hierarchy Process (AHP) is
Commitment, with the score of 0.148, 0.127 used only for weighting each criterion in
and 0.90, respectively. The criteria with the objective and subjective criteria.
lowest weight were Flexibility, which
showed by the score 0.022. Therefore,
Based on the table 4 and table 5, it is Table 6 Weighting Priority Of Each Subjective
known that the objective criteria with the Criteria
highest score are Work Quality (0.650). Criteria of Weighti Criteria of Weighti
Meanwhile, the subjective criteria with the Subjective ng Subjective ng
highest score wereExpertise (0.148). The Measures Priority Measures Priority
weight of each criterion that has been Expertise 0,148 Developing 0,049
Others
obtained will be used for scoring. The score
Costumer 0,127 Concern 0,048
will be multiplied by the weight of each Service For Order
criterion in order to determine the difference Orientation
between the results of the criteria. The Organizatio 0,090 Analitical 0,045
addition of the weight of each criterion is nal Thinking
expected to make the performance Commitme
assessment more objective. nt
Achievemen 0,082 Self 0,041
3.2.2 Determining the Assessment Scale t Confidence
The scoring stage of the performance Orientation
Team work 0,078 Information 0,034
appraisal refers to a Rating Scales Rating
Seeking
Rating model with five rating scales. The size Relationshi 0,065 Interperson 0,032
of the appraisal is adjusted according to how p Building al
the company judges the operator The Understand
assessment scale for objective and subjective ing
measures is useful in the creation of a new Initiative 0,058 Conceptual 0,028
performance appraisal system as a guideline Thinking
for assessment measures. With a clear Self control 0,052 Flexibility 0,022
assessment scale, it is expected that Junior
Manager's assessment of the operator will 2. Quantity of Work
refer to the size guidelines so that the results In the quantity of work, the output calculated
are more objective. on the bending process is the component.The
process of bending component is using 6
3.2.2.1 Determining the Scale of Objective types of machines;1 unit of 5.56 mm caliber
Measures machine (INT), 1 unit of 5.56 mm caliber
1. Absenteeism (Presence) machine (EXT), 1 unit of 9 mm caliber
The value of absenteeism is obtained machine, 1 unit of Caliber 2 TJ Machine, 1
from absentee recaps that have been done by unit of RECT Hall Rooks Machine OP, and 1
the personnel department. The Company unit of Hall Docking Machine D. The
determines that the attendance of all company determines the number of
employees and operators is only calculated components to process dents every 2 months,
on the basis of attendance or absence. in accordance with the total number of units
Operators with personal permission, sickness, to be produced for both make to stock and
loss to follow-up, and delays of more than 15 make to order products. The production
minutes without notice will be counted not target per day in the bending process is
present. 650,000 items. The component that has been
Based on Table 7, it can be seen that successfully processed will proceed to the
workers with 0 absence will get an next stages.
assessment scale of 5.If the absence is
between 1 to 5 days, then the assessment
scale is 4. If between 6 to 10 days, the
assessment scale is 3.If 11 to 15 the days, the
assessment scale is 2. Finally, if the absence
is between 15 and 18 days, the assessment
scale will be 1.
Table 12 Assessment scale of work safety there are five criteria that will be converted to
Assessment Injury Severity Work Days the criteria fromSpencer competency. Table
Scale 13 converts the prior criteria into the new
5 Not significant. Not causing criteria.
Events do not cause lost
harm or injury to workdays. Table 13 The conversion of subjective criteria
humans. Accuracy No New criteria No Old criteria
and caution when
1 Expertise 1 Abilityto
working high.
maintain the
4 Small. It results in Can still
machine and
minor injuries, work on the
operation
minor losses and no same day.
2 Costumer Service 2 Abilityto instruct
serious impact on
Orientation the work process
production
3 Organizational 3 Quality standard
continuity.
Commitment in the area
3 Medium. Moderate Lost
4 Achievement 4 Loyalty and
injuries and working
Orientation dedication for
hospitalization, no days under
the work
permanent disability, 3 days.
5 Team work 5 Initiative and
moderate financial
will
loss.
6 Relationship
2 Serious. Causes Lost
Building
severe injuries and working
7 Initiative
permanent days 3 days
disabilities and large or more. 8 Self-control
financial losses and 9 Developing
has a serious impact Others
on production 10 Concern For
continuity. Order
1 Disaster. Causing Losing the 11 Analytical
the death toll and working Thinking
severe loss can even day forever. 12 Self Confidence
stop the business 13 Information
forever. Seeking
Based on Table 3.10 ,if the accident 14 Interpersonal
does not cause injury, the operator will get Understanding
5.If it is a minor injury, the operator will get 15 Conceptual
4.If the accident causesmoderate injury, Thinking
operator will get a scale of 3. Furthermore, 16 Flexibility
severe injuries and permanent disability will
get a rating scale of 2, and if the accident Some criteria from the old assessment
causes death, the operator will get the score are aligned with the criteria on Spencer
of 1. competency. Thus the design does not
eliminate the criteria that have been used
3.2.2.2 Determining the Assessment Scale before but improve it with the criteria from
of Subjective Measures Spencer competency. Table 3.14 shows the
The assessment of operator performance scale of the subjective assessment. Especially
was based on subjective measures using for expertise competency, there is an addition
Spencer competency that included 16 of criteria for the type of curving machine.
competencies. The assessment of the rating This is due to expertise competency
scale refers to the assessment dimension of assessment is done based on the operator's
Spencer's competencies but with few changes ability or expertise about the machine. This
based on the discussions with the personnel merger serves to make the new scoring
and Junior Manager. In the prior assessment, model in more detail.
3.2.2.3 Differences in Results of Prior 3.2.2.4 The Differences of Prior and New
Performance Assessment and the New Performance Assessment
Assessment Using AHP and Rating Scales The last difference lies in the results of
The difference is not only in the number both types of scoring systems.
of criteriabut also the scoring scale. The prior
scoring system had 4 types of assessment Table 15 The Differences in Results of Prior and
scales for each category, namely, Exceed New Performance Assessment
Expectation, Meets Expectation, Name Prio Ne Name Prio Ne
r w r w
Improvement Desired, and Unsatisfactory Kasiyan B A Khoirul B A
Performance. Meanwhile, the new M
performance assessment has 5 types of rating Nurul B A Roby B A
scale for each category and category Sihabudin Noer
classification. This amount corresponds to Rochiem C A Agung C B
Yuli P W
the Rating Scales method of Outstanding Arif Kukusu
C B C A
Performance, Exceed Expectation, Meets Hidayatullo
Expectation, Improvement Desired, and h
Unsatisfactory Performance. Sesario C B Yoga C A
Aldis Putra P
Table 14 Differences in scale category of the Faizal Z C C Dwi C A
Afrianto
prior and new assessment
Rizal C C Bagus T C B
Scal New Output Scal Prior Prasetya
e Category (Annu e category
Rizky D C Galih C B
al
Bahtiar Yoga C
Bonus)
Isman C A Rizki C A
A Very Good 100% A Exceed
Mahfud Fauzi P
Outstanding Expectation
Andi C A Saiful C B
Performance
Afrianto Anwar
B Good 85% B Meets
Moch. Aris C B M. C B
Exceed Expectation
M Muflih H
Expectation
Rahmanda C A Wisnu C B
C Enough 60% C
A.H Dimas S
Meets Improvemen
Expectation t Desired Ahmad C B Ennan C C
Saiful H Ristianto
D Poor 40 % D Unsatisfacto
Improvemen ry M. Syukron C B Edi C C
t Desired Performance Santoso
E Very Poor 0% Riyanto C B Adiyta K D C
Unsatisfacto M. Adi C A Aldiki C A
ry Saputro Yudi S.
Performance Suyadi C A Mufti C A
Haikal
Rizki Brian C B Khoimar B A
The table shows that the indicators are A u Z.
different. The prior system had no criteria for Kriswanto C A Doni B A
each criterion, but using only one scale that Pramana
was previously created. There was no
provision from an appraiser, and this will Based on Table 3.13, there was an
provide an appropriate score for non- increase that the average operator who got
technical ability, as the scale created is more the category better than before is shown on
suitable for technical skills. Meanwhile, the the blue, green and orange lines. Operators
new score has the criteria for each criterion, who got 2 times better improvement from the
and the criteria are tailored to that criterion. previous performance category were 13
The addition of this arena will make it easier people, such as Rochiem from category C to
and clearer, also more objective as it is not category A. This increase is due to the new
only based on the assessors only. assessment includes some new criteria that
were not includedin the old assessment, such
as absenteeism, work quantity, work quality concern for order, initiative, information
work, work safety, Teamwork, Developing seeking, interpersonal understanding,
others, and so forth. On the absenteeism customer service orientation, relationship
criteria, the operator gets a value of 5, which building, developing others, teamwork,
means the operator never lost any days of analytical thinking, conceptual thinking,
work. In addition, operators also scored high expertise, self-control, self-confidence,
on some subjective measure criteria, flexibility, and organizational commitment).
including Achievement Orientation, The prior scoring system has 4 types of
Relationship Building, Developing Others, assessment scales for each category; Exceed
Teamwork, Team Leadership, Analytical Expectation, Meets Expectation,
Thinking, and Expertise. Improvement Desired, and Unsatisfactory
These results illustrate that the operator Performance. Meanwhile, the new
has a high discipline, is responsible for the performance assessment system has 5 types
job, has leadership skills, and has excellent of rating scale either for each category or for
qualities in the operation of the curving class category determination. This amount
machine. However, There are 4 operators that corresponds to the Rating Scales method of
do not show improvement or still get the Outstanding Performance, Exceed
category C (yellow mark),including operators Expectation, Meets Expectation,
named Faizal Z, Rizal Prasetya, Enan Improvement Desired, and Unsatisfactory
Ristianto, Edi Santoso. This is due to the low Performance.
value on the objective measures, such as on Based on the results of the work
the absenteeism criteria. Operators were assessment, there is a difference between the
absent for at least 3 times. When the operator assessment results with the prior scoring
lost 3 days of work, then thevalue will be 2. system and the new assessment system. The
The low score on absenteeism criteria is prior system showed the result that there
considered the highest priority. In addition, were only 2 operators with “B” category, 3
the low value is also found on the subjective operators with “C” category, and 2 operators
measures for the Initiative criterion, which is with D category. On the other hand, the new
worth 1. The operator does not perform the assessment system revealed that there were
task if not prompted. Both of these results 1 operators with “A” category A, 13
show that the discipline and responsibility of operators in category B, and 6 operators in
the operator to his work are poor, hence the category C. The result differences are due to
results of the assessment indicate is low or the application of additional criteria, such as
categorized in Improvement Desired. The use absenteeism (presence), quantity of work,
of objective and subjective measures allows work quality, work safety, Teamwork, and so
the assessment to see operators better than forth.
others and vice versa so that it can be
considered to determine the amount of annual References
bonus for the operator.
[1] Aamodt, M. G. Industrial/
4. Conclusion Organizational Psychology: An
The new system of performance Appied. Approach. Sixth Edition.
assessment is an improvement of the prior USA : Wadsworth Cencange
scoring system that refers to the objective Learning. 2010.
and subjective measures. The objective
[2] Saaty, T.L. Exploring the Interface
measures are including absenteeism
between Hierarchies, Multiple
(presence), the quantity of work, quality of
Objectives and the Fuzzy Sets. Fuzzy
work, and safety. The measures are used
Sets and Systems, 1, 1978, 57-68.
since the assessment results of the operator's
http://dx.doi.org/10.1016/0165-
performance can be viewed holistically. The
0114(78)90032-5
subjective measures include 16 Spencer
competencies (achievement orientation,