Testing FAQ's -- Provided By Dhiran Kariappa QEDGE - Satyam Computer services Ltd

 

1.   What types of documents would you need for QA, QC, and Testing?  
brs and srs and use cases, test plan test cases.

2.   What did you include in a test plan?  
Test Plan is a big document that contains all the information about your project, objectives, scopes, roles and responsibilities, test-set(set of test cases), test -bed(types of testing, execution environment), test-strategy, schedules etc.

3.   Describe any bug you remember.  
Examples: Due to silk test tool does not support default synchronization concept, so the tool fails, since there is no time out option in tools menu. For eg follow these steps: 1.select 1st record in flight reservation form 2.perform some change in test record

3.Click update order 4.Open Help from the flight 5.run the script

4.   What is the purpose of the testing?  
The purpose of testing can be quality assurance, verification and validation, or reliability estimation. Testing can be used as a generic metric as well. Correctness testing and reliability testing are two major areas of testing. Software testing is a trade-off between budget, time.

5.   What do you like (not like) in this job?  
like: it’s very interesting, challenging by thinking about the application in the end user's perception. it is interesting that we are doing destructive work but in the long term it is a constructive work.

7.   What is the difference between QA and testing?  
QA is more interested in the Process whereas Testing is more interested in the Product. As rightly pointed out by some people, QA i.e. oriented towards prevention and testing is oriented towards detection.

8.   How do you scope, organize, and execute a test project?  
Execution of tests is completed by following the test documents in a methodical manner. As each test procedure is performed, an entry is recorded in a test execution log to note the execution of the procedure and whether or not the test procedure uncovered any defects.

9.   What is the role of QA in a development project?  
QA is responsible for the Preventive action. That's QA is necessary right from the requirement gathering phase. QA engineer needs to set a goal for each and every stage of the project life cycle and make sure the development team achieves the plan. If not conduct casual analysis meeting to find out problem and eradicate in the upcoming phases

10.   What is the role of QA in a company that produces software?  
Quality assurance personnel are responsible for validating project assumptions and ensuring the quality of phase deliverables. Quality assurance personnel should be independent of the development process

11.Define Quality

For me as you understand it quality is a process to satisfy the given requirement and delivered on time, cost effective and its maintainable

12.   Describe to me the difference between validation and verification.  
Verification takes place before validation, and not vice versa. Verification evaluates documents, plans, code, requirements and specifications. Validation evaluates the product itself. The input of verification is the actual testing of an actual product. The o/p of verification is nearly perfect set of documents, plans, specifications and requirements

13.   Describe to me what you see as a process. Not a particular process, just the basics of having a process.  
The sequence of activities, people, and systems involved in carrying out some business or achieving some desired result

14.   Describe to me when you would consider employing a failure mode and effect analysis.  
FMEA (Failure Mode and Effects Analysis) is a proactive tool, technique and quality method that enables the identification and prevention of process or product errors before they occur.  Failure modes and effects analysis (FMEA) is a disciplined approach used to identify possible failures of a product or service and then determine the frequency and impact of the failure

15.   What are the properties of a good requirement?  
Very clear, complete, attainable, cohesive, testable

16.   How do you differentiate the roles of Quality Assurance Manager and Project Manager?  
Their duties are different. The QA manager is a part of the project in which he is responsible for the quality of the intended project where as the project manager is responsible for the whole project and he coordinates all the departments in making project

17.   How do you deal with environments that are hostile to quality change efforts?  
It depends on the end user or client.  if he is computer literate, then it's better to provide clear documentation on each and every feature and actions.  if he is not computer literate, then reengineering(start from the scratch) is better.

18.   In general, how do you see automation fitting into the overall process of testing?  
For this first we have to see the drawbacks of Manual testing.  1.More no. of people required.  2. More time is consumed.  3. it's a tedious task.  4.We can't repeat the test easily 5. Concurrency is missing Automation

19.How do you promote the concept of phase containment and defect prevention?  

Phase Containment (prevention of spread of something harmful):  Suppose we find a defect at design stage. so we prevent that to spreading to the next stage. i.e. we traced back that defect and correct that in requirements and then in design. After that only you can go to next phase.

Defective Prevention: QA people try to prevent defects by monitoring the whole development process

20.   What kinds of testing have you done?  
I handled functionality testing, GUI Testing, Database testing, Regression Testing. Also involved in Smoke testing once a build is released from the development team.

21.   Have you ever created a test plan?  
Test plan is nothing but the events, which drives the testing activities; test leads handle this job.

22.   Have you ever written test cases or did you just execute those written by others?  
Primary responsibility of the tester is to write the test cases. Writing test cases and executing his own test cases gives best result in testing.  After studying the functional and technical documents I prepare test cases and test the application basing on the test cases written

23.   What did your base your test cases?  
My test cases mainly base on the CRS (Customer requirement specifications)& SRS (System requirement specifications), The CRS should include all functional & non-functional requirement specifications.

24.   How do you determine what to test?  
Study the Requirements document, design document thoroughly, to understand the main functionality of the application. After u gets a clear idea on that then only start write test cases. if u have any doubts send them to the concerned person(Generally by Test lead or Business Analyst)

25.   How do you test if you have minimal or no documentation about the product?  
In this situation I will try to test the application with the perception of end user. And i use my (or someone’s) previous experiences. Here we are not preparing any formal test plans and testcase documents.  Most of the time we perform adhoc testing on this application

26.  Describe me to the basic elements you put in a defect report?  
The bugs are entered into a bug-reporting tool. Nowadays, every organization uses the Test Director as their Test Management Tool. This has Defects section, where you can follow the Steps after Clicking Add Defect Button

27.   How do you perform regression testing?  
Regression Testing is carried out both manually and automation. The automatic tools are mainly used for the Regression Testing as this is mainly focused repeatedly testing the same application for the changes in the design etc. It involves executing test case with defects until they are removed completely.

28.   At what stage of the life cycle does testing begin in your opinion?  
Testing starts right from the requirements

29. How do you analyze your test results? What metrics do you try to provide?  
Test results are analyzed to identify the major causes of defect and which is the phase that has introduced most of the defects. This can be achieved through cause/effect analysis or Pareto analysis. Analysis of test results can provide several test metrics like Defect Density, Test effectiveness, DRE

30.   Where do you get your expected results?  
We get expected results from the SRS and Functional Design Documents.  If there is no clear documentation we prepared expected results from 1. Previous similar products. 2. by communicating with the developers 3. by common sense

31.   If automating - what is your process for determining what to automate and in what order?  
Which test case to automate: 1: test cases that need to run for every built.(also called sanity testing) 2: test that uses multiple set of data values for same action(called data driven testing). 3: identical test that need to be executed 4.mission critical pages that won’t change in short term.

32.   Tell me about the best bug you ever found.  
We do manual testing on printers/MFP's.  The best bug i was found in the pre-gold release of product, i.e printer is not printing due to improper build  

33.   What made you pick testing over another career?  
I am very proud be as a tester because a tester needs to know each and every activities in the SDLC, and his role in more important/ responsible when the quality aspects are concerned. If a developer makes a mistake that can be resolved by a tester but if tester makes mistake and if the customer find a bug then it will cost high.

34.   When should testing start in a project? Why?  
Functionality of the product depends on coding & coding is done according to the requirements. if the requirements aren’t clear, the resultant product is not a quality product. Hence testing starts right from the requirements. once the requirements are done feasibility study is done on design functional specifications

35.   How do you go about testing a web application?  
It’s clear that for testing any application, one should be clear about the requirements and specification documents. For testing Web application, the tester should know, what the web application deals with.

36.   Would you like to work in a team or alone, why?  
TEAM: Together Everyone Achieves More. The software testing is teams work with more focus on testing individual modules/functionality, which are related to the functionality of everyone in the team. I would like to work in a Team as well as individually

37.   Give me 5 strong & weak points of yours  
willing to work in a team and as an individual whenever needed. Strong communication skills, Strong desire for quality, able to communicate with both technical and non-technical people. Always ready to learn new skills.

38.   When should testing be stopped?  
When the test manager is confident that the application will perform as expected in the production environment. This confidence is derived by analysis conducted on:  a) Deadlines (release deadlines, testing deadlines, etc.) are met b) Test exit criteria are met 3. Functionality is tested 4.Test budget is depleted

39.   What sort of things would you put down in a bug report?  
Usually bug report contains. * path ( module / link) * bug severity * posted by * assigned to * status * resolution * screen shots for reference

40.   Who in the company is responsible for Quality?  
I feel that Quality is every individual's responsibility wherein he/she contributes towards it in their own way. In real time clients should define Quality.

41.   Who defines quality?  
To measure the Quality several are there. some of them are 1. correctness 2. reliability 3.maintainability 4. portability 5.interoperability 

42.   What is an equivalence class?  
If a set of object can be linked by a relationship that is symmetric, reflexive and transitive then we can say there is equivalence class. Using this concept Equivalence Partitioning method of Black Box Testing divides the input domain of a program into classed of data from where test case can be derived. Ideally each testcase can uncover class of errors that might otherwise require many testcase t5o be executed before general error is occurred.

43.   Is a "A fast database retrieval rate" a testable requirement?  
No. But this can be a testable if the requirement is clear and specifies the acceptable range of retrieval rate i.e. less than 1 second etc.

44.   Should we test every possible combination/scenario for a program?  
Use boundary value analysis technique and equivalence class. Using that we can reduce the no of possible combination

45.   What criteria do you use when determining when to automate a test or leave it manual?  
It depends on the project, which we are working. If the project is customizable and used by several clients after small changes to the product.

46.   When do you start developing your automation tests?  
When the application becomes stable, when there are no more major changes in the application then we automate that part which performs regression testing

47.   Discuss what test metrics you feel are important to publish an organization?  
1) Defect Density 2) Defect Detection effectiveness 3) Test effectiveness 4) Tester Effectiveness 5) Defect Distribution 6) Bugs Severity 

48.   Describe the role that QA plays in the software lifecycle.  
QA's role to be management's eyes and ears to understand how well the s/w is being build and to know when corrective actions are needed. By measuring and monitoring the s/w development, qa helps to determine if organization’s standard and procedures are being ignored. QA identifies the reasons and help management to determine the steps that must be taken to being the development activities in the line with the expectations.

49.  How would you define a "bug?"  
An error is a human action that produces an incorrect result and the presence of an error at the time of execution of software is what is called as a bug or defect.

50.   How does unit testing play a role in the development / software lifecycle?  
We can catch simple bugs like GUI, small functional Bugs during unit testing. This reduces testing time. Overall this saves project time. If developer doesn't catch this type of bugs, this will come to integration testing part and if it catches by a tester

51.   Describe a past experience with implementing a test harness in the development of software.  
Harness: an arrangement of straps for attaching a horse to a cart. Test Harness: This class of tool supports the processing of tests by working it almost painless to 1. Install a candidate program in a test environment 2. feed it input 3.Stimulate by Stubs the behavior of subsidiary modules

52.Have you ever worked with QA in developing test tools? Explain the participation

Development should have with QA in leveraging such test tools for QA use.

53.   How would you describe the involvement you have had with the bug-fix cycle between Development and QA?  
as a tester my duty is  1. Find the bug 2. Severity of the bug. 3. Mention type of the bug 4. Give attachments if any 5. If it is reproducible, mention the steps to reproduce 6.sugession if any. 7.mention date 8.ur Sign

54.   How do you know when your code has met specifications?  
With the help of tracebility matrix. All the requirements are tracked to the test cases. When all the test cases are executed and passed is an indication that the code has met the requirements

55.   How do you know your code has met specifications when there are no specifications?  
Without requirements one cannot validate the software whether it has met the requirements or not. In this case the customer's acceptance can be treated as meeting the specifications.

56.   How do you feel about cyclomatic complexity?  
It is used to measure the complexity of software process. It determines the how many number of inputs are needed to test the application in all the possible ways to execute the program.

57.   Who should test your code?  
PL or TL or the tester i.e QA person who has experience with development. Yah i agree the Code Testing i.e Code review is a apart Of white box testing

58. How do you survive chaos?  

I survive chaos by maintaining my calmness, focusing on work

59.   What processes/methodologies are you familiar with?  
Waterfall, Spiral Model

60.   What type of metrics would you use?  
QAM: Quality Assurance Matrix TMM: Test Management Matrix PCM:Process Compatibility Matrix

61.   How to find that tools work well with your existing system?  
if u have about ur tool 1. first do the work manually then compare this result with the tool producing result. 2. compare ur tool with the other similar competitive products in the market.  i.e; test whether ur tool and other tool which is performing well in the market

62.   How would you ensure 100% coverage of testing?  
we can not perform 100% testing on any application. but the criteria to ensure test completion on a project is 1. all the test cases are executed with the certain percentage of pass. 2. bug falls below a certain level 3. test budget depleted 4.Deadline reached 5.When the functionalities are covered in test cases 6.All critical & high bugs must have a status of closed

63.   What you will do during the first day of job?  
In my present company HR introduced me to my colleagues. And i known the following things. 1.what is the organization structure? 2.what is the current project developing, on what domain etc., 3.I will know to whom i have to report and what are my responsibilities.

64.   What would you like to do five years from now?  
I would like to be in a managerial role, ideally working closely with external clients. I have worked in client-facing roles for more than two years and I enjoy the challenge of keeping the customer satisfied. I think it's something I'm good at.

65.   What are your greatest weaknesses?  
"I used to have a tendency to procrastinate. So now I am always sure to set a strict schedule for all of my projects well in advance and I set personal deadlines. This organization has really helped."   "Once in a while, I focus too much

66.   What is a successful product?  
A Successful product is :- 1) Bugs Free  2) Quality should maintain  3) In Time Delivered in the Market 4) It should be Standard in Market with high demand  5) It should be useful to most of the people with out any Complaints

67. What do you like about Windows?  

User friendliness

68.   What do you like about QA?  
QA certainly is more challenging because U R trying to prevent the bugs !

69.   What has not worked well in your previous QA experience and what would you change?  

70. How you will begin to improve the QA process?  

By following methodologies like waterfall or spiral

71.   What is the difference between QA and QC?  
Actual testing = Quality Control of a project  Quality Control = Processes used to test the Project Functionality  Quality Assurance = Measures the quality of QC processes used to create a Quality Project.

72.   What is UML and how to use it for testing?  
Use Cases can developed using UML. Scenario Testing is based on Use Cases. i.e Use Case describes the user interaction with the system/Application. it simplifies a complex process of Software Design making a blueprint for construction.

73.Do you have a favorite QA book?

Effective Methods for Software Testing-William e. Perry

74 .   How much interaction with users should testers have, and why?  
Normally the SRS or client specs are referred.  However when the project undergoes constant modifications from the client, testers can sit in on the conversations chats so that they have a general idea of where the projects is headed. Also many

75 .   What are the roles of glass-box and black-box testing tools?  
Glass-box is a synonym for white box testing technique. Also called structural testing. As the name suggests it's concerned with testing the internal logic of the application with access to code. Whereas in Black box testing U don't have access to code

76.   What issues come up in test automation, and how do you manage them?  
Main issue is the frequent change request. If there are frequent changes in the system, as an automation engineer, we need to take care of the changing objects and functionalities to update the scripts.

77.   What is the role of a bug tracking system?  
A bug tracking system is used to report all errors at one central place for easy access and retrieval, both by developer as well as tester. Since all the bugs are centrally filed, it becomes easy to update their status.  The tracking can be done across multiple projects and lastly ,there details can be used by a QA Manager for metrics.

78.   What are the key challenges of testing?  
challenges of testing is writing test cases.  A good test case is one that has a high probability to find an yet undiscovered error.  A successful testcase is one which uncovers the error that is not yet find.

79.   Have you ever completely tested any part of a product? How?  
it is not possible to test any product completely.  We can test major functionalities of the application which are most visible to user.  And critical parts in the product.

80.   When have you had to focus on data integrity?  
I feel, we have to take data integrity issues right from integration test phase.

81.   At what stage the design of a project or application is validated  
Should start from the first phase itself. But conventional testing will start after coding phase.

 

82.   How do you prioritize testing tasks within a project?  

We can prioritize testing tasks within a project by determining the risk factor of each and every module on the basis of impact and likelihood and then start testing the module having the highest risk factor.

83.   How do you handle conflict with programmers?  
Maintain a better relationship with the developers. Before raising the Bug make sure that the bug is a real & valued one. Don’t blame the developer for mistakes.

84. What do you think the role of test-group manager should be? Relative to senior management? Relative to other technical groups in the company? Relative to your staff?  
ROLES OF test-group manager INCLUDE  

*Defect find and close rates by week, normalized against level of effort (are we finding defects, and can developers keep up with the number found and the ones necessary to fix?) 

* Number of tests planned, run, passed by a week

*defects founds per activity Vs total defects found

*Shedule estimates Vs actuals

* People on project, planned Vs actual by week or month

*Major or Minor requirement changes

85.   What is the testing lifecycle and explain each of its phases?  
TEST PLAN PREPARATION TEST CASE DESIGN TEST EXECUTION TEST LOG PREPARATION DEFECT TRACKING TEST REPORT PREPARATION

86.   What is Negative testing?  
Testing with an aim to break the application.

87.   What is the Capability Maturity Model (CMM)? At what CMM level were the last few companies you worked?  
CMM :- Capability Maturity Model developed by the SEI. It's a model of 5 levels of organizational maturity that determine effectiveness in delivering quality software.

88.   What is a "Good Tester"?  
A good tester is one who finds the bug as early as possible and make sure the bug is fixed

89. What methodologies have you used to develop test cases?  

ECP, BVA

90. In an application currently in production, one module of code is being modified. Is it necessary to re- test the whole application or is it enough to just test functionality associated with that module?
It depends on the functionality related with that module.We need to check whether that module is inter-related with other modules.If it is related with other modules,we need to test related modules too.Otherwise,if it is an independent module,no need

91.   What is good code?  
a code which is 1.bug free 2.reusable 3.independent 4.less complexity 5.well documented 6. Easy to change is called good code

92. Who is Kent Beck, Dr Grace Hopper, Dennis Ritchie?  
Dr. Kent Beck is the computer scientist who developed the Extreme Programming(Xp) methodology.

Dr Grace Hopper is a woman who done a lot of work on early computers and who used primitive programming techniques to the use of sophisticated compilers.

Dennis Ritchie- C

93.  What are basic, core, practices for a QA specialist?  
QA always monitors the project from beginning to end. if there is process violation takes places then he takes a CAPA(corrective action and preventive action). his work is preventive work. he does his work by conducting reviews, meetings, walkthroughs

94.   Define each of the following and explain how each relates to the other: Unit, System, and Integration testing.  
Unit system comes first. Performed by a developer. Integration testing comes next. Performed by a tester System testing comes last-Performed by a tester

95.   Explain the differences between White-box, Gray-box, and Black-box testing.  
Black box testing Tests are based on requirements and functionality. Not based on any knowledge of internal design or code.   White box testing  Tests are based on coverage of code statements, branches, paths, conditions. Based on

96.   What is the difference between a test strategy and a test plan?  
Test strategy is a general framed structure where as test plan is a specifi document which describes all the testing efforts to be acheive the objective defined in the strategy.

97.   What is IEEE? Why is it important?  
" Institute of Electrical & Electronic Engineers."   Organization of engineers, scientists and students involved in electrical, electronics, and related fields. It also functions as a publishing house and standards-making body. 

98.   Do you support automated testing? Why?  
Yes i support automation because it simulates user actions.

99.   We have a testing assignment that is time-driven. Do you think automated tests are the best solution
Main reason for using automated testing is it is not time consuming. Suppose for a project having more releases in a short span of time, automation testing is very useful for doing regression testing and smoke testing. But for a small project (<400fp), automation testing is not preferable

100.   We believe in ad-hoc software processes for projects. Do you agree with this? Please explain your answer.  
Ad-hoc testing should used only when the requirements are not written, or is not documented like an extreme programming .Normal projects where there are baseline requirements ,should not follow ad-hoc testing procedure. It must have test plan, test case, test report

101.   When is a good time for system testing?  
Once the integration testing is over and found that a minimum 80% of testcases are passed and the failed testcases are not show stoppers, then we can start performing system testing.

102.   Are regression tests required or do you feel there is a better use for resources?  
Regression testing is required only if there are adequate number or release. This is to ensure that by releasing a new version, the existing functionalities are not getting affected. Automated testing tools play a big role here.

103.   Why did you ever become involved in QA/testing?  
QA is the most important part of software life cycle. Also I would like to be in a team, which is responsible for the quality of software. QA also has broad opportunities since it is not dependent on any technology.

104.   What was a problem you had in your previous assignment (testing if possible)? How did you resolve it?  
Testing aimed at showing software does not work Negative testing may also be referred to as "dirty testing  

105.   What is the difference between smoke and sanity testing?  
Smoke testing is non-exhaustive software testing, ascertaining that the most crucial functions of a program work, but not bothering with finer details.  Sanity testing is a cursory testing; it is performed whenever a cursory testing is sufficient tp prove application is functioning according to application. the level of testing is a subset of regression testing. It normally includes a set of core tests of basic GUI functionality to demonstrate connectivity to the database, application server, and printer’s etc/

106.   What is visual source safe?  
Visual Source Safe (VSS) is a configuration management tool. It is a family member of Visual studio: It is used to control versions.

107.   Explain how testing fits in V-model?  
Testing should do along with development process. That is what Spiral SDLC is talking about. In V model, testing and development phases are performing parallel. In that aspect Testing fits in V model

108.   Under which category of testing, user acceptance testing comes?  
Alpha and Beta Testing

109.   What is difference between Authentication and Authorization?  
Authentication-->Checking the validity.Ex:A creditcard validation by Verisign.It is called authenticating the CreditCard  Authorization-->Giving some rights -Ex:I authorize Mr. Rahul to sign some papers realted with my bank accounts



Adds Long