QA Bible
QA Bible
QA Bible
com>
3. Have you written Test Plan? What is a Test Plan? What does it include?
Answer: Yes.
1
and its solutions.
What does it include?
A Test Plan includes Heading, Revision History, Table of Contents, Introduction,
Scope, Approach, Overview, different types of testing that will be carried out, what
software and hardware will be required, issues, risks, assumptions and sign off
section.
How many Test Cases did you write in your last project?
I wrote about 1100 Test Cases in my last project. (The reasonable number of Test
Cases varies from 500 to thousands. The number 1100 test cases can be completed in
6-month project duration).
5. Did you have a situation where you did not have any documents (no
requirement document, no Use Cases, or no Design Document) and you had to
write the Test Cases? How did you write the Test Cases in this situation?
Yes. I have been to that kind of scenarios several times. There were companies
where they had no documents at all. In that case, I had to discuss the application
scenario and functionalities with the Business Analysts or developer. On the basis of
that discussion, I prepared a document in consultation with Business Analysts and
Developers and then started writing Plans and Test Cases.
2
Can you tell me what a Use Case is?
A use case is a document that describes the user action and system response for a
particular functionality.
(i)Generating a Concept – A concept comes from the users of the software. For
example, a Pizza Hut may need software to sell pizza. An Indian store may need
software to sell its newly arrived movies or grocery. The owner of the company feels
that he needs software that would help him in tracking his expenses and income as
well as enhance the selling process. This is how the concept is generated. The owner
will specifically tell the software company what kind of software he would need. In
other words, he will specify his requirements.
(ii) Requirements analysis – After the owner (user) knows his requirements, then it
is given to a software team (company) who will analyze the requirement and prepare
requirement document that will explain every functionality that are needed by the
owner. The requirement document will be the main document for developers, testers
and database administrators. In other words, this is the main document that will be
referred by everyone. After the requirement documents, other detailed documents
many be needed. For example, the architectural design which is a blueprint for the
design with the necessary specifications for the hardware, software, people and data
resources.
(iii) Development: After the detailed requirement documents (some companies have
design documents instead of requirement documents), the developers start writing
their code (program) for their modules. On the other hand, the testers in the QA
(Quality Assurance) Department start writing Test Plans (one module=1 test plan),
test cases and get ready for testing.
(iv) Testing: Once the code (programs) are ready, they are compiled together and to
make a build. This build is now tested by the software testers (QA Testers)
(v) Production: After testing, the application (software) goes into production
(meaning, it will be handed over to the owner).
(vi) End: And one day, the owner will have say bye to the software either because the
business grows and this software does not meet the demand or for some reason, the he
does not need the software. That’s the end of it.
3
This document has the further details of the Business Requirement Document. This is
a very crucial step in Software Development Life Cycle (SDLC). Sometimes the
Business Requirement Document and Business Design Document can be lumped
together to make only one Business Requirement Document.
16. Are Test Plan and Test Strategy same type of documents?
4
No, they are different documents. A Test Plan is a document that collects and
organizes test cases by functional areas and/or types of testing in a form that can be
presented to the other teams and/or customer (see the definition on this page for Test
Plan) where as the Test Strategy (see the definition in the above question) is the
documented approach to testing. The tester prepares test Plan whereas the Manager or
lead prepares the Test Strategy. Both are important pieces of Quality Assurance
processes since they help communicate the test approach scope and ensure test
coverage while improving the efficiency of the testing effort.
18. What are different types of software testing and define them?
Unit testing
2) Shakeout testing
3) Smoke testing (Ad-hoc testing)
4) Functional testing
5) Integration testing
6) Regression testing
7) System testing
8) Load testing
9) Stress testing
10) Performance testing
11) User acceptance testing
12) Black box testing
13) White box testing
14) Alpha testing
15) Beta testing
(Note: Except the Shakeout testing and Unit testing (which are respectively done by
the CMT (Configuration Management Team) and Coder/Developer), all other testing
are done by the QA tester.)
What is Unit testing? It is a test to check the code whether it is properly working
or not as per the requirement.
5
This test is basically carried out to check the networking facility, database
connectivity and the integration of modules. The Configuration Management
team, who prepare builds for test environments, normally does this test. They also
test whether the major components of the software are not broken. This test is
done BEFORE the build is deployed in the test environment. After the shake out
testing, the next step is smoke testing (which is done by the testers after the build
is deployed in the test environment).
What is smoke testing? This test is done when the build is just prepared (fresh
build) and deployed in the test environments. This is basically an ad hoc test to
check roughly to make sure the major functionalities are not broken. It is the
preliminary a test carried out by the QA tester. After the smoke test, the testers
perform functional testing.
What is Functional testing? It is a test to check whether each and every function
of that application is working as per the requirement (remember this work “as per
requirement document”-you must say this in the interview). It is a major test
where 80% of the tests are done. In this test, the Test Cases are executed (or run).
What is Integration testing? It is a test to check whether all the modules are
combined together or not and working successfully as specified in the
requirement document. (Just for your information: Each developer works on
different modules. When they finish their code, the configuration management
team puts them together and prepares a build. We, as testers, need to make sure
that these modules, which are now combined, work as per requirement document)
What is System testing? When testers complete testing (The testers test the
application in the test environments, meaning they test with the test data only,
NOT with the real data), the application (software) has to be tested in the real
environment. What it means is, since the testers test it in the test environment with
the test data, we have to make sure that the application works well in the real
environment with the real data. In test environment, some of the things cannot be
simulated or tested. Al though the test environment is very similar to the
production (real) environment, we need to make sure that we get a smooth
delivery in the real system as well (As servers are different and database is
different, things may not work as expected when the application is moved from
test environment to production environment).
What is Load testing? It is a test to check the user’s response time for number of
6
users using any one scenario (single business process) of the same application at
the same time.
What is Performance testing? It is a test to check the user’s response time for
number of users using multiple scenarios (multiple business process) of the same
application at the same time.
(Did you notice the difference between Load Testing and Performance testing?
What is it? See the highlighted bold letters)
What is Stress testing? In this type of testing the application is tested against
heavy load such as complex numerical values, large number of inputs, large
number of queries etc. which checks for the stress/load the applications can
withstand.
What is User acceptance testing (UAT)? In this type of testing, the software is
handed over to the user in order to find out if the software meets the user
expectations and works as it is expected to. In this testing, the tester may do the
testing or the clients may have their own testers (For example, banks may have
their own teller employees who can test the application).
What is Black box testing? It is test where a tester performs testing without
looking into the code. (OR it is a testing method where the application under test
is viewed as a black box and the internal behavior of the program is completely
ignored. Testing occurs based upon the external specifications. Also known as
behavioral testing, since only the external behavior of the program is evaluated
and analyzed.)
What is White box testing? It is a test where a tester looks into the code and
performs the testing.
What is Alpha testing? In this type of testing, the users are invited at the
development center where they use the application and the developers note every
particular input or action carried out by the user. Any type of abnormal behavior
of the system is noted and rectified by the developers.
What is Beta testing? In this type of testing, the software is distributed as a beta
version to the users and users test the application at their sites. As the users explore
the software, in case if any exception/defect occurs that is reported to the developers.
19. What is the difference between Load Testing and Performance Testing?
Basically Load, Stress and Performance Testing are the same. However, Load
testing is the test to check the users’ response time of number of users of any one
scenario of the application whereas Performance Testing is the test to check the user
response time for multiple scenario of the same application.
7
20. What was the process of QA testing in your company where you worked for
the last time? (Or As far as the QA process is involved, what was the testing
process in your company?)
The QA testing process that was followed in my last company where I worked was as
follows:
First of all the Business Requirement Document was prepared as per the client’s
requirement (with the muck-up). Then on the basis of the requirement document, QA
Team wrote Test Plans, Test Cases and Test Strategies. The developers started coding
their modules (started programming). Once the developers finished coding, the
Configuration Management Team compiled the code together and prepared a build.
This Build is now deployed to different testing environments where different types of
testing were performed. Once the defects were found, the testers would log the defect
using the tools available (like Test Director, Clear Quest and so on. For the
companies who cannot afford these expensive tools, they can use Excel sheet as
well). Once the defects are logged, then those defects would be discussed in the
defect status meeting and would take further actions (meaning, closing, reopening,
retesting of defects etc).
8
23. What is Backend Testing?
It is a test to check whether the data displayed in the GUI front-end matches with the
particular data in the backend.
24. Have you done any Backend Testing and/or if you did, how did you do it in
your last project?
Yes. I have done backend testing. When I was working in my last project, this was
my scenario of backend testing:
I was working on Reports. It was the scenario of testing one application used in the
bank, where a customer comes to a bank’s front desk, the bank teller is requested to
open a Checking Account. The associate then asks for the personal information about
the customer, which, are the primary data, such as: First Name, Last Name, Date of
Birth, Address and Social Security Number. The associate then puts these primary
data of that particular customer into the computer, which then afterwards batch-
processed (normally happens in the middle of the nigh). Now, after the batch process,
the information of that customer goes into the central database in the XML format.
The data now from the database goes to ETL (Extract-Transform-Load). (ETL is a
tool made by two companies ‘AbInitio’ and ‘Informatica’) ETL now processes the
job to create a file (output file) to produce the report. The file is now displayed in the
GUI Front End report with the help of Business Object (or Crystal Reports. These are
tools that display data in GUI format). In the GUI Front End report, let us say, if for
January, the deposit of that person was displayed as $ 900.00. Then my job was to
validate whether this $900 is correct or not. I validated this data by writing SQL
queries directly to the database. The data pulled from my SQL query should match to
the data in the GUI front end. In other words, my SQL query should also display
$900. If it matches, it is well and good. If it doesn’t, then it’s a bug. This is how I
have done my Back End Testing.
How can you be sure that the query you wrote is correct? Or how do you know
that the data you pulled from the database is correct?
I write SQL query based on the requirement document. In the requirement
document, various conditions are given for the query. Based on those conditions, I
write SQL query. Therefore, anything different from the requirement document is
definitely a defect.
25. From you resume, I see that you have been working in one place for a very
short period of time. This raises me questions why. Can you explain why?
As a consultant, I am hired for a certain period of time (for project duration only),
normally for 6 months to 1 year. Once the project is over, I needed to move to another
project. That’s why you see me in the resume jumping frequently here and there.
9
On the first day, the Manager will come to receive at the lobby. He/she will welcome
you; tell where you will be sitting. The next thing will be will show you login name
and password and they want to make sure that the login name and password works so
that you can use your computer. Then the Manager will tell you where the documents
are located in the network drive (or shared drive, or Clear Case, or Sharepoint -
different companies use different software for this purpose). Once you find the
documents, then you will ask them what you will be working on what are the related
documents that you should read. You start reading the documents, which lasts
normally one week or more.
27. What do you do on the job every day? What is the first thing you go when
you go to work on a day? (What is your routine job?)
Go to work, have a cup of coffee (coffee is free in any work place), then check
emails. I will check in my calendar whether there is any meeting for the day. If there
is anything urgent work that needs to take care of, then I will start with that job.
Otherwise, I will start what is left from yesterday on a priority basis.
(This question was asked to one of my friends. When they asked him this question,
his answer was, he said, “I start testing”. This was his wrong answer. The answer
varies in which phase of testing the application is. If the application is in very
beginning state-meaning that the coding has just begun, then the tester’s job will be to
analyze and read the requirement documents, write test plans and write test cases.
Probably attend walkthrough meeting and so on. However, the daily routine job
would be, as mentioned above, check emails, read documents, attend meeting and so
on. It’s not that as soon as you enter the office, you start testing).
What do you do if you have any questions to ask? Who do you ask?
At the beginning, we all panic, what kind of questions to ask? What if they ask
questions that I don’t know? Is it OK to ask questions? What do I do if I don’t know
how to do the job I am assigned to?
As mentioned earlier, on the first day, your Manager will give you the system
(computer) (They normally call system, not computer), will tell you what the User ID
and Password is, where are the QA documents on the shared drive (or Network drive)
are and so on. They will definitely ask you to read a lot of documents at the beginning
(And you must read those documents AS MUCH AS POSSIBLE. At the beginning,
allocate about 2 hours extra at home for reading these documents. This habit will put
you on the top of your job). These documents are normally design specification
document (DSD). Different companies call it with different names, for example,
Requirement Specification Document (RSD) and so on. After reading the documents,
you will be asked to write Test Plans or Test Cases (The Test Plans and Test Cases
templates will be give by your manager or test lead and they will tell you what to do
and how to do because different companies have different formats they follow. If they
don’t have one, then you can always prepare a sample from this website (see on the
10
right column) and give it to them.
11
29. When you log a defect using Test Director (or Clear Quest) what fields do
you see?
When we log a defect, we see Defect ID (it shows later in Test Director), Summary
(where we write short description of the defect), Description (long description of the
defect), Detected by (Person who found the defect, (it’s you), Severity (meaning-is
the defect critical? High? Medium? Or Low?), Date, Detected in Version, Priority,
Project, Status, Assigned to and so on.
31. Do you have any situations in the past where you have some arguments with
your team members?
No. I never had that type of situation wherever I have worked.
(Even if you had one, it’s a good idea to say “No”. This could be a red flag, which
might stop you from getting the job)
32. What do you like about a Manager? And what don’t you like?
The best thing I like about a Manager is that the Manager should be able to
coordinate with the other teams so that we can get the updated documents, for
example, updated requirements documents right away. A Manager who can
efficiently in distributes the work to the team, without being biased and easily
accessible and protective to his team for the right cause. As far as “what I don’t like”
is concerned, I don’t like a manager who keeps coming to desk 10 times a day to
check my work even if it is just a regular work. Once the responsibility is given, the
team member should be trusted and let his work done.
12
in production as well. Therefore, I am involved from the very beginning to the end of
the software development life cycle (SDLC) process. I like this.
Another reason is I like to find defects. I enjoy logging defects. The more defects I
find, the happier I am.
37. If you have no documentation about the product, how do you test an
application? Describe the process.
Well, this is a situation where I have come across several times. Some of the
companies in my previous projects did not have any documents. In this case, I went to
the Business Analyst and some times to developers to find out how exactly the
functionalities work, how to navigate from one page to another page and so on. After
getting a clear vision, I write test cases based on the conversation (which is a step by
step procedure to test an application) and get ready for testing.
Recreate the Defect: Once you find a defect, we must try to recreate (meaning that
we should be able to reproduce it) at least 3 times so that we are sure that it is a
defect. Some times, once we find it log it without recreating, may put us in a false
situation (because sometimes the application does not behave in the same way).
Therefore, it is important to recreate the same defect several times.
Attach the Screen Shot (supporting document): Once we confirm that it is a defect,
and then it is a good idea to attach supporting documents when we log (write) a
defect. For example, screen shot, requirement document etc. For instance, let us say
that instead of “Continue” button on a page, there is a typo “Continue”. Now, we will
make a screen shot of this page (To make screen shot, press “Print Screen” button on
the keyboard, and open a Word document, and Click Edit on the Word document and
“Past” it. You will see the screen now) Now, a tester needs to write defects in easy
and clear language to make all the developers to understand easily.
Log the Defect: Now, the next step is, we need to log it. Depending on the company
what kind of tools they are using (for example, some companies use Test Director to
log defects, some companies use Rational Clear Quest, some use PVC Tracker and so
on). If the company is small and cannot afford these expensive tools, then they may
simply use Excel sheet to log defects. We log the defect.
13
Basic elements we put in a defect are: SEVERITY, PRIORITY, CREATED BY,
VERSION NO, HEADER, DESCRIPTION OF THE DEFECT where we write how
to recreate a defect, in what module the defect is found, Status, and so on.
41. As a QA Tester, can you tell me the situation when you felt the most proud of
it?
When I find the defect that normally others don’t find, then I feel very proud. For
example, there were situations where I found bugs that crashed the whole system at
the end of testing phase. I tried the scenarios where the scenarios were NOT
mentioned in the test cases. For example, we can close the windows by clicking X on
the page, with “Close” button and so on. But there is another way that you can close
the window, by pressing Alt+F4 on the keyboard. Not many testers test this scenario.
I have done this in my last two projects. Both the time, the application crashed which
became a big issue. I felt proud.
14
documents, attending walk-through meetings, writing test plans, writing test cases,
executing the test cases (or running the test cases) testing the application, logging
defects, retesting them and so on. I think I really like the process and that’s why I
chose this career.
43. When should testing start in a project? Why?
We should start testing as soon as the following things are ready:
-Test Data are ready
-Build (all the developers have coded their code and merged them
together)
-Test Environment (servers, network etc) is set up and ready
-When the manager asks us to go ahead and start testing.
44. Let us say you have a web application to test. How do you go about testing it?
What is the process?
First of all, I will look at the requirement documents (or design document in some
companies). The requirement document will tell us what the functionalities in the
application (software) are. Once I analyze the requirement documents (one
module=one requirement document). After that, I will write test plans for each
module (one module =one test plan). Then after the test plan is complete, I will write
test cases (One module can have hundreds, even thousands test cases). Once the test
cases are ready and the application is ready (or once the build is ready), then I will
start testing. Before I start testing, however, I will make sure the test environments,
test data and defect logging tools are in place. This is how I will go about testing an
application.
46. How would you ensure that you have covered 100% testing?
The testing coverage is defined by exit criteria (There is exit criteria and entry criteria
in the Test Strategy). For example, if the exit criteria says “The software will be
acceptable to the client only if there are no critical defects, no high defects, no
medium defects and only two low defects”, then all the critical, high, medium should
be zero. Only 2 low defects are acceptable. Thus, 100% coverage is measured by the
exit criteria. Also, 100% test cases must be executed in order to cover 100% of
testing.
47. What problems did you face in the past? How did you solve it?
(You will be OK if you just give one of the problems below, not all of them)
I had many problems while testing applications in the past. As far as I remember one
15
of them (then describe one of them from below), this was the scenario:
(i) It was a web-based application. I was working on a module called “Transaction
Summary”. There was “Submit” button on that page. After entering data in the all the
fields, for example, First Name, Last Name, Social Security Number, Date of Birth
and so on, I clicked the Submit button. Once I clicked Submit button, an error page
displayed, “Page cannot be found…”. Since it was a critical defect, I immediately
informed the Test Lead. There was chaos in the room. All the developers, Database
Administrators and Testers gathered in my cube (room). No body could tell exactly
what was wrong with it. Finally, one smart guy checked into the database and found
out that one of the files in the database was closed. The status of all the files should
be in the open status. Once the status of the closed file was put in the “open” status,
the application worked fine.
(ii) One of the problems was in the Login window (page). When the user enters and
Login Name and Password, then Password should be encrypted. One of the Test
Cases was that I needed to open database and see whether the password is encrypted
or not. I found out it was not encrypted. I reported it as a bug (defect) and it was fixed
in the next release (build).
(iii) Defects I have found in a project was a defect to close a window (pop up).
For example, in the last project, on a page, there was a button called “More
Information”. Once the user clicked that button, the system would open a new
window (pop up). We could close the new window in 3 ways:
-By clicking X at the top right corner of the page
-By clicking “Close” button on the page
-By pressing combination keys (Alt+F4) on the key board
Although the combination key (Alt+F4) was not mentioned in the test case, I just
wanted to try how the application reacts when Alt+F4 is pressed. Then I pressed
Alt+F4. The result was a disaster-the application crashed (broke). The application
disappeared from the computer monitor. Since it was the last day of testing for us, it
brought chaos in our Managers, Leads and the whole teams. Finally, the developers
disabled Alt+F4 as a temporary solution and the application went into production.
(iv) Another problem was that a user would search for branch location information of
a bank. The user logs in by using User Name and Password. After the log in, on the
“Search Location” page, the user enters and zip code of the location he wants to find,
then clicks Find button. After that the system (application) gives a number of branch
locations. The user now clicks “Request Information” for one of the branches. As
soon as the user clicks “Request Information” button, the application breaks (displays
“Page cannot be found” error). I logged this defect as a critical defect. When the
developers and database administrator looked into it, then they found out that in one
of the tables, the data was not recorded. In all the tables (User Profile table, ClientID
table and SessionID table), the data should be populated with the information entered
by the user. For some reason, in one of the tables, it was blank (null). Once they
16
wrote a small code to populate data (enter data) to the table, the application started
working.
(v) In my previous project, when the customer wants to upload a document, for
example, a copy of a monthly statement (in Word format), on the website, the system
should automatically change the Word document into .pdf format. Once the document
was uploaded, I saw that the fields in the .pdf document were interchanged
(misplaced). For example, the First Name displayed in the Last Name section. Date of
Birth displayed in the Social Security Number field and so on. We found out that the
problem was a mapping problem (remember this word). Once the mapping was
correct, I tested in the new build. It was fixed.
(vi) The most common problem that I have faced in my previous projects are the Java
script errors, data connectivity, error, HTTP 500 error (This error occurs when server
is down), HTTP 400 error (when file is not found) and so on.
(vii) “Father” pop up displayed when Print/Print Preview button clicked. (This was
coded by the developer to mark this coding portion for his/her own purpose as a mark
to indicate where he/she made changes, however, forgot to remove it). Once the
developer fixed it, it still displayed the same thing (because it was in the servers
memory and could not go). Now, I had to reset memory of the server from my
machine. Therefore, what I did is, I went to the website I was testing (for
example, http://mysite.app.org/My_profile) and added reset.aspx at the end of the
URL (Now the URL becomeshttp://mysite.app.org/My_profile/reset.aspx and hit
enter. It took me to the server memory and I selected section and submitted the query
and it was cleared. Retested again and it is now OK.
(viii) I was testing a web application. On one page, I clicked Save & Continue button
twice (my mistake). Once this button is clicked twice, the system displayed an error
message, “Could not save the answers, please contact technical support”. (When
clicked only once, the button works fine.).
Solution: Once the user clicks the button once, the button was disabled later so that
the user cannot click twice.
(ix) I was testing a web-based application. Once all the fields are entered on the one
of the pages, we had Print Preview button. If the user clicks this button, we were
supposed see the same information in a new window in PDF format. While looking at
the data in PDF file, there were some fields missing, for example, Date of Birth was
missing in the PDF file.
48. Tell me about the worst boss you’ve ever had. (Here, you should be careful not
to say any negative words about the past boss. This will give a reflection that you
cannot work with different nature of people. You should be able to show them that
you can cope with any king of boss. Therefore, just take an idea below how the
17
answer should be.)
I can hardly think of any Manager that was really bad. But when I compare, then I
remember of a Test Lead who was just made a lead from the developers team. She
used to feel that she has been very proud of her position and used to boss around.
Some times, she used to call home and check where I was and what I was doing. Or
have I completed my job before leaving and so on. I think, whatever she did, was in
the benefit of the company and myself in the long run which would give me more
confidence in future.
Validation: Validation is a process to check whether the product design fits the
client’s need. It checks whether you built the right thing. It checks whether it is
designed properly.
18
criteria. When we are about to finish testing, then the QA Team (QA Manager) refers
to the exit criteria (exit criteria tells the level of defect that you can be comfortable
with before it goes to production. For example, there should be ZERO critical defect,
ZERO high level defect, ZERO medium defect, 1 Low level defect, all the test cases
must be 100% executed etc). Once the exit criteria meet the requirements, then the
software is considered to be sufficiently tested.
53. How to derive test scenarios and use cases? What are the contents and
format?
Test scenarios are derived from requirement documents. We follow each and every
functionality (called business rules) mentioned in the requirement document. One
functionality can have multiple business rules. For example, let us say in there is one
requirement called “Login”. This “Login” may have various scenarios. For example,
one scenario is, enter the right User ID and wrong password. The system should
display an error message. Another scenario would be to enter wrong User ID and
right Password. The system should display an error message. The third scenario could
be to enter the right User Name and right Password. The system should allow the user
to get into the system. This is how the test cases are derived from the requirement
documents or from the Use Cases.
54. What are the types of test cases that you write?
We write test cases for smoke testing, integration testing, functional testing,
regression testing, load testing, stress testing, system testing and so on.
56. How to write Regression test cases? What are the criteria?
Regression test cases are also based on the requirement documents. They are written
more into detail and with every release (build), the testers need to do regression
testing. The criteria for regression testing are; there should be no major defects while
we do our smoke test and functional testing.
57. Is there a format for a test case? Do you follow any methodology for
numbering test cases?
Yes. It depends upon the company how the company has followed the numbering of
test cases. However, normally, it is just a simple numbering in most of the time. But
some companies may also relate this numbering to the requirement number. For
example, if the requirement for Login is “REQ-LOG-001”, then we can number the
19
test cases like REQ-LOG-001-001 and so on.
59. How to write User Acceptance Test plan & test cases?
The way of writing Test Plan and Test Cases is the same in all the test phases.
However, specifically for User Acceptance Testing, the testers use data nearly real
data (meaning that the data is very much similar to the production data or real data).
62. What will you do if developer does not accept the bug?
If the developer does not accept the defect, then he will reject it. Once it is rejected,
then it comes back to the tester. Now, the tester will ask for clarification with the
developer why the defect is rejected. Since everything is based on the requirement
documents, both tester and developer will have to look at the requirement document,
validate it and then reopen it if necessary or close.
20
63. What are the different tests that can be done for Client Server Application
and Web-based Application? Give details.
For both client server and web based applications, the testing is the same except one
thing: We test web based applications in different browsers, for example, Internet
Explorer (will test in different versions like IE 5.0, IE 6.0, IE 7.0), Firefox, Safari (for
Mac) and so on where as for client server, we don’t need to test in the browsers.
65. Give me five common problems that occur during software development.
Poorly written requirements, unrealistic schedules, inadequate testing, adding new
features after development is underway and poor communication. Requirements are
poorly written when requirements are unclear, incomplete, too general, or not
testable; therefore there will be problems. The schedule is unrealistic if too much
work is crammed in too little time.
Software testing is inadequate if none knows whether or not the software is any good
until customers complain or the system crashes. It’s extremely common that new
features are added after development is underway.
Miscommunication either means the developers don’t know what is needed, or
customers have unrealistic expectations and therefore problems are guaranteed
21
deeper problems in the software development process, such as insufficient unit
testing, insufficient integration testing, poor design, improper build or release
procedures, managers should be notified and provided with some documentation as
evidence of the problem.
22
not require redoing the application from scratch. Additionally, try to… · Ensure the
code is well commented and well documented; this makes changes easier
for the developers.
· Use rapid prototyping whenever possible; this will help customers feel sure of their
requirements and minimize changes.
· In the project’s initial schedule, allow for some extra time to commensurate with
probable changes.
· Move new requirements to a ‘Phase 2′ version of an application and use the original
requirements for the ‘Phase 1′ version.
· Negotiate to allow only easily implemented new requirements into the project; move
more difficult, new requirements into future versions of the application.
· Ensure customers and management understand scheduling impacts, inherent risks
and
costs of significant requirements changes. Then let management or the customers
decide if the changes are warranted; after all, that’s their job.
· Balance the effort put into setting up automated testing with the expected effort
required to redo them to deal with changes.
· Design some flexibility into automated test scripts;
· Focus initial automated testing on application aspects that are most likely to remain
unchanged;
· Devote appropriate effort to risk analysis of changes, in order to minimize
regression-
testing needs;
· Design some flexibility into test cases; this is not easily done; the best bet is to
minimize the detail in the test cases, or set up only higher-level generic-type test
plans;
· Focus less on detailed test plans and test cases and more on ad-hoc testing with an
understanding of the added risk this entails.
71. What if the application has functionality that wasn’t in the requirements?
It may take serious effort to determine if an application has significant unexpected or
hidden functionality, which it would indicate, deeper problems in the software
development process. If the functionality isn’t necessary to the purpose of the
application, it should be removed, as it may have unknown impacts or dependencies
that were not taken into account by the designer or the customer.
If not removed, design information will be needed to determine added testing needs
or regression testing needs. Management should be made aware of any significant
added risks as a result of the unexpected functionality. If the functionality only affects
areas, such as minor improvements in the user interface, it may not be a significant
risk.
23
processes and adjust and experiment as an organization grows and matures.
Productivity will be improved instead of stifled. Problem prevention will lessen the
need for problem detection. Panics and burnout will decrease and there will be
improved focus and less wasted effort. At the same time, attempts should be made to
keep processes simple and efficient, minimize paperwork, promote computer-based
processes and automated tracking and reporting, minimize time required in meetings
and promote training as part of the QA process. However, no one, especially talented
technical types like bureaucracy and in the short run things may slow down a bit. A
typical scenario would be that more days of planning and development will be
needed, but less time will be required for late-night bug fixing and calming of irate
customers.
24
Security/penetration testing is testing how well the system is protected against
unauthorized internal or external access, or willful damage. This type of testing
usually requires sophisticated testing techniques.
25
The test plan may include test cases, conditions, the test environment, and a list of
related tasks, pass/fail criteria and risk assessment. Inputs for this process:
· A description of the required hardware and software components, including test
tools. This information comes from the test environment, including test tool data.
· A description of roles and responsibilities of the resources required for the test and
schedule constraints. This information comes from man-hours and schedules.
· Testing methodology. This is based on known standards.
· Functional and technical requirements of the application. This information comes
from requirements, change request, technical and functional design documents.
· Requirements that the system cannot provide, e.g. system limitations. Outputs for
this process:
· An approved and signed off test strategy document, test plan, including test cases.
· Testing issues requiring resolution. Usually this requires additional negotiation at
the project management level.
26
Approved Test Strategy Document.
Test tools, or automated test tools, if applicable.
Previously developed scripts, if applicable.
Test documentation problems uncovered as a result of testing.
A good understanding of software complexity and module path coverage, derived
from general and detailed design documents, e.g. software design document, source
code and software complexity data.
Outputs for this process:
Approved documents of test scenarios, test cases, test conditions and test data.
Reports of software design issues, given to software developers for correction.
27
Functional testing,
System testing,
End-to-end testing,
Sanity testing,
Regression testing,
Acceptance testing,
Load testing,
Performance testing,
Usability testing,
Install/uninstall testing,
Recovery testing,
Security testing,
Compatibility testing,
Exploratory testing, ad-hoc testing,
User acceptance testing,
Comparison testing,
Alpha testing,
Beta testing, and
Mutation testing.
88. How do you divide the application into different sections to create scripts?
First of all, the application is divided in different parts when a business analyst writes
the requirement document (or Use Cases or Design Document), he/she writes EACH
requirement document for EACH module. Let us say, if there are 12 different
modules in an application that a business analyst has written the requirements for,
then a tester would write the test cases for each module, which means in 12 different
sections. This is the standard practice. There might be scenarios where you might
have to break down scripts into sub-categories. For example, if a tester is writing a
script for Login Page, he/she might write one for positive and negative testing and
another sub-set of test cases would be for error message when the wrong information
is entered. In short, the test cases are divided according to the modules.
28
91. What did you learn from your previous companies?
I learned a lot from the previous companies wherever I have worked. Wherever I
have worked, I found out the there is always something to learn. Different companies
have different ways of working. The environment and technology always differ from
one company to another company. I have never found one company’s environment
matching with another company. For example, if one company is using documents
called requirement documents, then the other company might be using Use Cases and
some companies might be using Design Document and so on. Therefore, in my
experience, there are always new things to learn in every company and we can always
contribute these things in the next company if they help to be more productive.
94. Did you get any compliments from your previous employers? What were
those situations?
Yes. I did. There were many occasions where I had compliments. For example, I
was testing an application going a little bit off my test cases. After I finished
executing my test cases, I always think in a way what a real user would possibly click
in various parts of the application. So I was just clicking back and forth and at one
specific scenario, the application simply broke and displayed an error message. That
scenario was not in the test cases. The manager really appreciated me and thanked for
finding this kind of critical defect. Answer: Yes. I did. There were many occasions
where I had compliments. For example, I was testing an application going a little bit
off my test cases. After I finished executing my test cases, I always think in a way
what a real user would possibly click in various parts of the application. So I was just
clicking back and forth and at one specific scenario, the application simply broke and
displayed an error message. That scenario was not in the test cases. The manager
really appreciated me and thanked for finding this kind of critical defect.
29
What are your strengths?
I am a very detailed oriented person. I have the sense of urgency. I can prioritize my
job according to the deadline. I am very much dedicated towards my job. I am honest.
I have the skills and expertise in QA process. These are some of my strengths.
Please provide information (an example) of your experience testing Linux and
UNIX environments (including type of system tested, how tested, actual
commands and steps used for test) Testing applications using Linux and UNIX.
I have tested applications using UNIX. For every backend testing I have done in the
past, I have used UNIX platform while performing backend testing. For example,
when the data is fed into the system in the front end, that data goes to the database
after the batch processing. From the database, the data is now sent to the ETL system
(in XML format) for data manipulation as per our need (ETL is a software tool of Ab
Initio company which is used to manipulate data in the data warehouse). In the ETL
system, we manipulate those data according to our need), for example, it could be
income statement of the company, balance sheet, monthly reports, and so on. In order
to produce income statement, we need to run a job in ETL. To run this job, we use
UNIX. In the same way, different types of jobs are created for each need (creating
balance sheet is another job, creating reports is next job etc) then I had to run
different jobs in the ETL system. Once we run the job, the running job finally creates
an output file which is now validated by us tester. This output file can be in text
format or GUI format. Thus, this is the scenario where I had to use UNIX. (I have
used Linux much, however, since UNIX and Linux are the same thing, I should have
no problem in using Linux).
30
Cd .. ———>change the directory one level up
Mkdir ———>make a directory
Rmdir ———>Delete the directory
setenv name v ——>Set environment
kill% ——–>Kill the running job
vi ———>editor Used to write scripts
more——-> to see the contents page by page
cat —–>list contents of the file
chmod ——–>change permission
cp ——–>copy
rm —–>delete a file
How do you do risk assessment? (This question was asked to Mona in her
interview)
(This is what Mona answered): The risks by understanding the infrastructure of the
application, hard drive and system capabilities etc. Also added “Risk and Mitigation
Strategy” column within the test plan. The major risk for the company was system
getting crashed upon receiving several hits by the users. Company did not set any
metrics at the development phase as to what it can handle. I told him that i noted
mitigation strategy to deal with each known risk within the test plan.
The following are the some of the things that a tester has to know (but may not
be asked in the interview) what is a cookie? (You must know how to clean
cookies)
A small text file of information that certain Web sites attach to a user’s hard drive
while the user is browsing the Web site. A Cookie can contain information such as
user ID, user preferences, archive shopping cart information, etc. Cookies can contain
Personally Identifiable Information.
31
right button here, therefore, that button name was changed from “OK” to “Continue”.
Accordingly, you wrote a defect saying that “OK” button should be changed to
“Continue” button. Now, this defect is fixed (the developer changed the “OK” button
to “Continue”). Now, you started testing, there is a possibility that you might see
“OK” button again. Why? Because you DID NOT clean your cookies.
Therefore, you must clean your cookies before you starting testing a new build.
2. Click Tools.
Click Clear.
Now the cookies are cleaned in Firefox.
32
Does a Tester need SQL?
Yes. For a Tester, SQL is needed. I had the same question in mind becore I came to
the actual implication-what is SQL used for? And now, I know that when we do the
backend testing (seeqaquestions.com for details), we need to write SQL queries to
retrieve the data from the database and compare this data to the one with reports or
output. Another scenario is, if something goes wrong in the application, for example,
if there is an error, then we might have to write SQL queries to retrieve the data from
the database and check what went wrong. Let’s say, we need to check in the Error
Log table what went wrong. To check this, we open the database, go to Error Log
table and find out that happened. In the Error Log table, there are many records, so
which one is your error then? To find out which one is yours, we need to write SQL
queries. Example, you logged in to the application with User ID=devin99 and
password=sn992jj. Now, to retrieve your record, you can write a query some thing
like this: select * from Error_Log where userID=devin99; this query will retrieve
your record only so that you can see what happened.
A showstopper is a defect or bug that stops the user for further action (testing). It has
no work around. In other words, it stops every thing and the user cannot go any
further. This is called showstopper in software industry language. (This is not an
interview questions, but you have to know this terminology).
33