Generating Test Cases
Generating Test Cases
Generating Test Cases
http://www.therationaledge.com/content/jun_01/m_cases_jh.html
fundamental step. Then test procedures are designed for these test cases,
and finally, test scripts are created to implement the procedures. Test
cases are key to the process because they identify and communicate the
conditions that will be implemented in test and are necessary to verify
successful and acceptable implementation of the product requirements.
They are all about making sure that the product fulfills the requirements of
the system.
Although few actually do it, developers can begin creating test cases as
soon as use cases are available, well before any code is written. We will
discuss how to do this, and the advantages you can reap from it, below.
The ovals represent use cases, and the stick figures represent "actors,"
which can be either humans or other systems. The lines represent
communication between an actor and a use case. As you can see, this usecase diagram provides the big picture: Each use case represents a big
chunk of functionality that will be implemented, and each actor represents
someone or something outside our system that interacts with it.
It is a significant step to identify use cases and actors, but now there is
more to be done. Each use case also requires a significant amount of text
to describe it. This text is usually formatted in sections, as shown in Table
1.
Table 1: Format for a Use-Case Textual Description
Description
Name
Brief Description
Flow of Events
Special Requirements
Preconditions
Post conditions
The most important part of a use case for generating test cases is the flow
of events. The two main parts of the flow of events are the basic flow of
events and the alternate flows of events. The basic flow of events
should cover what "normally" happens when the use case is performed.
The alternate flows of events covers behavior of an optional or exceptional
character relative to normal behavior, and also variations of the normal
behavior. You can think of the alternate flows of events as "detours" from
the basic flow of events.
Figure 2: Basic Flow of Events and Alternate Flows of Events for a Use Case
1. Logon
This use case starts when a Student accesses the Wylie
University Web site.
The system asks for, and the Student enters, the student ID
and password.
4. Select Courses
The Student selects four primary course offerings and two
alternate course offerings from the list of available course
offerings.
5. Submit Schedule
The student indicates that the schedule is complete. For each
selected course offering on the schedule, the system verifies
that the Student has the necessary prerequisites.
Figure 3: Textual Description for the University Course Registration Use-Case Basic
Flow of Events
1. Unidentified Student
In Step 1 of the Basic Flow, Logon, if the system determines
that the student ID and/or password is not valid, an error
message is displayed.
2. Quit
The Course Registration System allows the student to quit at
any time during the use case. The Student may choose to save
a partial schedule before quitting. All courses that are not
marked as "enrolled in" are marked as "selected" in the
schedule. The schedule is saved in the system. The use case
ends.
As you can see, a significant amount of detail goes into fully specifying a
use case. Ideally, the flows should be written as "dialogs" between the
system and the actors. Each step should explain what the actor does and
what the system does in response; it should also be numbered and have a
title. Alternate flows always specify where they start in the basic flow and
where they go when they end.
Use-Case Scenarios
There is one more thing to describe before we concentrate on how use
cases can be used to generate test cases: a use-case scenario. A use-case
scenario is an instance of a use case, or a complete "path" through the
use case. End users of the completed system can go down many paths as
they execute the functionality specified in the use case. Following the
basic flow would be one scenario. Following the basic flow plus alternate
flow 1A would be another. The basic flow plus alternate flow 2A would be a
third, and so on.
Table 2 lists all possible scenarios for the diagram shown in Figure 2,
beginning with the basic flow and then combining the basic flow with
alternate flows.
Table 2: Scenarios for the Use Case Shown in Figure 2
Scenario 1 Basic
Flow
Scenario 2 Basic
Flow
Alternate Flow
1
Scenario 3 Basic
Flow
Alternate Flow
1
Scenario 4 Basic
Flow
Alternate Flow
3
Alternate Flow
2
Scenario 5 Basic
Flow
Alternate Flow
3
Alternate Flow
1
Scenario 6 Basic
Flow
Alternate Flow
3
Alternate Flow
1
Scenario 7 Basic
Flow
Alternate Flow
4
Scenario 8 Basic
Flow
Alternate Flow
3
Alternate Flow
2
Alternate Flow
4
These scenarios will be used as the basis for creating test cases.
Scenario Name
Basic Flow
Basic Flow
A1
Basic Flow
A2
Basic Flow
A4
Basic Flow
A5
Basic Flow
A3
Scenario/
Condition
Expected
Result
RC 1
Scenario 1successful
registration
RC 2
Schedule
and
confirmation
number
displayed
Scenario 2- I
unidentified
student
N/A
N/A
N/A
N/A
N/A
Error
message;
back to
login screen
RC 3
N/A
N/A
N/A
N/A
Login screen
appears
RC 4
Scenario 4course
registration
system
unavailable
N/A
N/A
N/A
N/A
Error
message;
back to step
2
RC 5
Scenario 5registration
closed
N/A
N/A
N/A
N/A
Error
message;
back to step
2
RC 6
Scenario 6cannot
enroll -course full
Error
message;
back to step
3
RC 7
Scenario 6- V
cannot
enroll -prerequisite
not fulfilled
Error
message;
back to step
4
RC 8
Scenario 6cannot
enroll -schedule
conflict
Error
message;
back to step
4
Notice that in this matrix no data values have actually been entered. The
cells of the table contain a V, I, or n/a. V indicates valid, I is for invalid,
and n/a means that it is not necessary to supply a data value in this case.
This specific matrix is a good intermediate step; it clearly shows what
conditions are being tested for each test case. It is also very easy to
determine by looking at the Vs and Is whether you have identified a
sufficient number of test cases. In addition to the "happy day" scenarios in
which everything works fine, each row in the matrix should have at least
one I indicating an invalid condition being tested. In the test case matrix
in Table 4, some conditions are obviously missing -- e.g., Registration
Closed -- because RC3, RC4, and RC5 each has the same combination of
Is and Vs.
Once all of the test cases have been identified, they should be reviewed
and validated to ensure accuracy and to identify redundant or missing test
cases. Then, once they are approved, the final step is to substitute actual
data values for the Is and Vs. Without test data, test cases (or test
procedures) can't be implemented or executed; they are just descriptions
of conditions, scenarios, and paths. Therefore, it is necessary to identify
actual values to be used in implementing the final tests. Table 5 shows a
test case matrix with values substituted for the Is and Vs in the previous
matrix. A number of techniques can be used for identifying data values,
but these are beyond the scope of this article.
Table 5: Test Case Matrix with Data Values
Test Scenario/
Case Condition
ID
Student
ID
RC 1
jheumann abc123
Scenario 1successful
registration
M101>
Yes
Yes
Yes
Schedule
and
confirmation
number
displayed
E201
S101
RC 2
N/A
N/A
N/A
N/A
Error
message;
back to
login screen
RC 3
jheumann abc123
N/A
N/A
N/A
N/A
Login
screen
appears
RC 4
Scenario 4course
registration
system
unavailable
jheumann abc123
N/A
N/A
N/A
N/A
Error
message;
back to step
2
RC 5
Scenario 5registration
closed
jheumann abc123
N/A
N/A
N/A
N/A
Error
message;
back to step
2
RC 6
Scenario 6cannot
enroll -course full
jheumann abc123
M101
Yes
M101
full
Yes
Error
message;
back to step
3
No for E201
Yes
Yes
Error
message;
back to step
4
E201
S101
RC 7
M101
E201
S101
RC 8
Scenario 6cannot
enroll -schedule
conflict
jheumann abc123
M101
E201
Yes
Yes
E202 and
S101
conflict
Error
message;
back to step
4
S101