Qualpro-Cm: An Overview of The Development of A Competency Measurement Support Tool
Qualpro-Cm: An Overview of The Development of A Competency Measurement Support Tool
Qualpro-Cm: An Overview of The Development of A Competency Measurement Support Tool
52-60
52
An Overview of the Development of a Competency Measurement Support Tool – QualPro-CM
c. Calculate the total score of all sections, ST QualPro-CM is custom-built to measure competency
level of an SQA team. The measurement process begins
N=S
with the design of a questionnaire, and followed by
ST = ∑ SS for N = 1, 2, ….., S
N=1
answering of the questionnaire by the SQA team
members, calculation of competency scores and analysis
Where, S: Total number of sections of results as shown in Fig. 2. Its development
(In this case, S = 3) methodology is both method-oriented and process-
oriented. The main functions of QualPro-CM are
defined according to the process flow as explained and
illustrated below.
53
Ow and Yaacob
A set of questions is created and stored in a database to Each SQA team member is notified through the send mail
be selected for use in the design of the questionnaire. function of QualPro-CM of the directory in the network
Basically, there are three types of question. The first type server where the questionnaire is located, and the date
comprises objective questions requiring an either a yes, and time to answer the questionnaire. A time limit of
no or not applicable answer. The second type comprises between 20-30 minutes is given to answer all the
questions with various options as the answers with a questions in a section. If an employee has not answered
check box against each option. Choice of one or more the section on the specific date and time, he will be
answers is allowed. The third type requires text input as denied access to the questions, and a new date and time
answers to elicit opinions or comments. In addition, three will have to be set for him to complete that specific
other types of questions are included. These consist of section. Also, once the employee has submitted his
questions which are combinations of one or more of the answers to the system for calculation, he would be denied
three basic types. Of the three basic types, only the further access to the questions.
objective type is used in the calculation of the
competency score. The other two types provide e. Calculation of Competency Scores
additional information for the final analysis of results.
Indeed, if the input questions are related to software After the employee has answered all the questions in a
development perspectives, the measurement of employee section and submitted it to the system, QualPro-CM will
competency for the software development team can also calculate the scores and store the results in a database.
be conducted using the KAP Model. The scores in the database include the section scores and
the competency score.
b. Design Questionnaire
f. Analysis of Results
In designing a questionnaire, relevant questions are
selected from the pools of questions in the database. The QualPro-CM performs analysis of results by comparing
questionnaire is divided into different sections. The the competency score obtained with the competency level
questions for each section are selected according to their defined by the evaluators. The training needs as
category. When designing the questionnaire, the point suggested by the employee in the feedback section of the
and weightage are also assigned for each question and questionnaire as well as from the evaluators, are also
section. generated. The evaluators can view these results, but not
the employee. If there is a need for an employee to know
c. Define Grading Scheme his section scores or competency score, the evaluators can
inform him using the send mail function of QualPro-
The evaluator or a group of evaluators decide on the CM.
competency levels that determine an employee eligibility
to participate in an SQA activity such as a review process.
These levels are input into the system and can be changed
or reviewed from time to time. The training needs for
each competency level are also entered into the system.
Table 1: Grading Scheme and Training Needs
54
An Overview of the Development of a Competency Measurement Support Tool – QualPro-CM
D C B A
(0-50) (51-70) (71-90) (91-100)
Not eligible to conduct requirements review process (RRP) Eligible to conduct RRP
Competency
Level
1 . Section A
2 . Section B
3 . Section C
The tremendous progress in Information Technology (IT) QualPro-CM consists of four main modules namely, User
has made it possible for much of the work in software Administration, Competency Measurement, Change
development to be distributed to desktops, laptops, network Password and Logout. The User Administration module
servers, wide area networks, and global web servers. More provides a set of functions that allow a system administrator
importantly, information driven through the IT systems has to manage new and existing users (i.e. employees). The
gained recognition as a primary corporate asset, that is functions and operations performed by this module are
crucial to building and maintaining a competitive listed in Table 2. The Competency Measurement module
advantage. Although the client/server environment is still enables an evaluator to maintain the competency
relatively new, many IT professionals, especially the measurement for a specific SQA activity, input questions,
software project developers, are getting aware of the design questionnaire, perform competency measurement,
advantages of the transition to the Graphical User Interface define the grading scheme and competency levels, analyse
(GUI), iterative development, relational database and open the results and to generate various types of reports for
system environment. Indeed, it is faster, easier, and more management use as shown in Fig. 3. The functions and
flexible to develop and deliver applications in the operations performed by this module are similar to the SQA
client/server environment [9]. QualPro-CM was thus Team Administration module and these include: to add new
developed based on the client/server architecture. The measurement, edit, delete and view measurement for the
following sections highlight the development process of maintain competency measurement function, to add new
QualPro-CM focusing on the identification of modules, questions, edit, delete, and view questions for the input
use of appropriate development tools and technologies, its questions function, etc. The Change Password module
high level design and concept of implementation. enables the user to change the password. The module
Logout allows the user to exit from QualPro-CM.
55
Ow and Yaacob
Function
Operation
Name
Add New • register a new user
• set user accessible modules
• create password for user
Fig. 3: The main functions of the Competency
Edit/Delete/ • edit user’s information and
Measurement Module
View module access rights
• delete a registered user
4.2 The Tools and Technologies Used
• view all registered user
Send Mail • send mail to a user
The development of QualPro-CM involved the use of a set
• send mail to a group of users
of Web-based development tools. These tools comprise a
• configure POP server of the
set of Microsoft products such as Internet Information
Server 3.0 (IIS 3.0), Active Server Pages (ASP), Microsoft system
Transaction Server 1.0 (MTS 1.0), and SQL Server 6.5,
Visual InterDev 1.0, Visual Basic Enterprise 5.0, Visual 4.3 The Design of QualPro-CM
Basic Scripting Edition (VBScript), and ActiveX [10, 11,
12, 13]. QualPro-CM shows a holistic Web development design
comprising applications at both the server and the client
Needless to say, there are various Internet development ends. Web applications tend to extend beyond pure
technologies to choose from to develop QualPro-CM. HyperText Markup Language (HTML), Web client, and
Among the main contenders are IBM’s offering of its Lotus Web server. There are many issues that need to be
Domino, Netscape’s Enterprise Server, and others. considered, such as component design, development
However, there are definite advantages for adopting the languages, database access, personalisation, and security.
Microsoft technologies. Firstly, QualPro-CM was
developed for application in both the Internet and Intranet QualPro-CM was developed based on a three-tiered
environments and appropriately selected Microsoft architecture. Tier 1 is the presentation layer, Tier 2 is the
Windows NT as its operating system. The latter has proven business rules/logic layer, and Tier 3 is the data
stability and provides good security features which are very management layer. The presentation layer furnishes the
essential for the type of network environment in which user interface for the overall system. It permits the end
QualPro-CM is applied. The choice of Windows NT itself users to enter and manipulate data, analyse information, and
brings some benefits in terms of reduced development navigate throughout the system. Validation and verification
costs, as the essential tools used, IIS and MTS, both come (V&V) logic is performed in this layer to edit input values
packaged with the system software itself and need not be and selections. The business rules/logic layer processes
separately purchased. Secondly, the use of a suite of other decisions, policy enforcement and resource management
Microsoft software development products such as ASP, decisions that ascribe to the data, state and event-processor
Visual Basic 5.0, SQL statements, etc., dispenses with the models. The data management layer maintains consistent
need to learn a variety of new programming languages in and secures data through the enforcement of referential
order to integrate all the tiers in the client/server integrity and data security. Transactions (i.e. operations)
and queries against the database such as accessing,
architecture on which QualPro-CM is based. For instance,
updating, inserting, locking, retrieving, security, and
the SQL statements, HTML, Visual Basic 5.0 and VBScript
backup are managed in this layer [14, 15].
used in the programming of QualPro-CM, all use a similar
syntax. This helps in the writing of more efficient and
All data entered into QualPro-CM is stored in a relational
clearly understandable codes, and thus, facilitates easier
database in a collection of tables. Each transaction
code maintenance. As such, all these translate into a
performed on the table is displayed in the browser as a Web
shorter development time and invariably contribute also to
page or a form. For example, if a user selects the add new
cost reduction in development. The use of Microsoft
operation of the input questions function of the Competency
development tools solely in the present implementation of
Measurement module, the client’s browser would first
56
An Overview of the Development of a Competency Measurement Support Tool – QualPro-CM
request a page from the Internet Information Server (IIS) transaction object by supplying an operation code of the
through the virtual directory (i.e. the directory where the transaction and the input collection. The operation code is
Internet surfer uses to access those files). The IIS gets an a predefined Structured Query Language (SQL) statement
ASP from the local directory (i.e. the directory where files template for a particular transaction.
are stored in the server’s hard disk), processes those server
code (i.e. those necessary server process) at IIS, and then When the transaction object is being invoked, it will be
sends the results to the browser in HTML format to based on the operation code and get the SQL statement or
insert/fill all the input boxes of the form, and then submit to command template from SQL server. It will then pass to
the IIS. Just before submitting the user input form to the the message binding (Msg Binding) object to bind the
server, a validation process (if any) will verify all the valid command template with the input collection. Message
users’ input by using client-site scripting. After that, the binder object will bind the command template with those
form will be sent to the server. The server will invoke inputs in the collection based on their data types. The
server-site scripting (i.e. ASP code) to collect those inputs output of the message binder is an executable SQL
and do some server-site validation as well (if any). command for the transaction. The transmission object is
responsible to the ‘traffic’ between MTS and SQL server.
After the client-site and server-site validations, all the It will send the executable SQL command from the
inputs will be sent to the business object (BO) which is message binder to the database (SQL server) and receive
created using Visual Basic 5.0 (VB5) and compiled as an any data from the database. The protocol between these
ActiveX object. At BO, it will get the context from processes is Open Database Connectivity (ODBC) [16].
Microsoft Transaction Server (MTS) in order to invoke the Fig. 4 illustrates the process flow of a client’s request to the
transaction object (all business objects created by VB5 are server in the three-tiered architecture. Fig. 5 and Fig. 6
installed in MTS). All the inputs from ASP will bind (i.e. depict the Active Server Pages (ASP) flow of the Add
the mechanism by which a client associates itself with a New/Edit/Delete and View operations. The explanations of
server) into a collection, followed by some processing (if these operations are given in pseudo-code.
any) before the transaction. Then, the BO will invoke
M
S M
B S
Client G
O G
Browser H A
I T
Net- N B X
T work S B I
F M
O O N T
Client M P D
Browser I
G Data
L B E N Service
O T G
57
Ow and Yaacob
Fig. 5: Active Server Pages (ASP) flow for the Add New/Edit/Delete Operations
58
An Overview of the Development of a Competency Measurement Support Tool – QualPro-CM
procedure
cbfFormProcess Server Code
(VBScript)
HTML
procedure &
cbfFormLoad Server Code
(VBScript)
Fig. 6: Active Server Pages (ASP) flow for the View Operation
All the functions performed by QualPro-CM are executed functionalities. As a Web-based application, there is
in this format iteratively until the user logout from the unrestricted time and access to the QualPro-CM from
system. This design methodology has contributed to a within and outside an organisation. Hence, the competency
structural, flexible and easy to maintain coding process. of an employee can be evaluated without the constraint of
time and location.
The trend and techniques in software development have [2] R. H. Dunn, Software Quality: Concepts and Plans.
undergone tremendous change. This is most notable in Englewood Cliffs, N.J. Prentice-Hall, Inc., 1990.
software reusability and Internet computing [17]. The
latter, in particular, has made it possible for software to be [3] B. Curtis, et al. A Field Study of the Software
distributed or dynamically shared as Web-based Design Process for Large Systems, IEEE
applications over the Internet. Based on this philosophy, Transactions on Software Engineering, Vol. 31
QualPro-CM was developed for the client/server (11), 1998, pp. 1268-1287.
environment and exploited the use of Web-based
development tools to enhance its features and
59
Ow and Yaacob
[4] A. Jarvis, and V. Crandall, Inroads to Software [16] P. E. Renaud, Introduction to Client/Server Systems:
Quality: “How To” Guide and Toolkit. Upper A Practical Guide for Systems Professionals. 2nd
Saddle River, N.J. Prentice-Hall, Inc., 1997. Edition. New York, John Wiley & Sons, Inc., 1996.
[5] C. P. Hollocker, Software Reviews and Audit [17] W. T. Tsai, Trends in Software Technology.
Handbook. New York, John Wiley & Sons, Inc., Proceedings of the Twenty-First Annual
1990. International Computer Software & Applications
Conference (COMPSAC’97), August 11-15, 1997,
[6] T. J. Swanson, and J. J. Devore, A Structured Washington, D.C. Los Alamitos, IEEE Computer
Approach To Hiring, in D. J. Reifer, Tutorial: Society, 1997, pp. 173-174.
Software Management. 3rd Edition. Washington,
D.C. IEEE Computer Society Press, 1986, pp. 217- [18] S. Jarzabek, and R. Huang, The Case for User-
220. Centered CASE Tools. Technical Report TRB9/96.
Singapore, Department of Information Systems and
[7] L. J. Arthur, Improving Software Quality: An Computer Science, The National University of
Insider’s Guide to TQM. New York, John Wiley & Singapore, 1996.
Sons, Inc., 1993.
60