Test Management
You are working on a project to develop an authentication system for an e-commerce website. This system provides two features: Registration and authentication. Two different development teams develop these two features.
There is a high likelihood that the delivery of the authentication feature to the test team will be three weeks later. To complete the registration the user must provide the following registration inputs: Name, surname, birthdate, fiscal code and he/she can select a username and a password.
A registered user can be a special user or a normal user. To be identified as a special user, he/she must also provide, during the registration process, a voucher possibly received from the IT department.
Access is granted only if a user is registered and the password is correct: In all other cases access is denied. If the registered user is a special user and the password is wrong, a special warning is shown on the system console.
You are currently performing a quality risk analysis using FMEA.
Based only on the given information, which of the following is NOT a product risk that could be identified during the quality risk analysis?
Number of correct responses: 1
K43 credits
Test Management
You are estimating the effort for the integration testing activities of a new project. Consider the following factors, which can affect that estimation:
I. Availability of re-usable test systems and documentation from previous, similar projects
II. Unexpected timing of components arrival
III. Stability of the integration test team (no turnover)
IV. Many and geographically distributed sub-teams
Which of the following statements is true?
Number of correct responses: 1
K21 credit
Test Management
The following chart plots the cumulative number of defects opened against the cumulative number of defects closed during system testing of a software product.
Which of the following statements is true?
Number of correct responses: 1
K21 credit
Test Management
You are the Test Manager of a new project that will have three formal levels of testing: unit, integration and system testing. The testing strategy you decide to adopt a blend of risk-based testing and reactive testing strategies.
Which of the following answers describes the most consistent example of implementation of this test strategy during the execution of the system tests?
Number of correct responses: 1
K21 credit
Reviews
Which of the following factors could negatively influence a review?
Number of correct responses: 1
K21 credit
Test Management
Which one of the following metrics to be produced needs traceability between the test cases and each item in a proper test basis?
Number of correct responses: 1
K21 credit
Reviews
You are the Test Manager of a project that adopts a V-model with four formal levels of testing: unit, integration, system and acceptance testing.
On this project reviews have been conducted for each development phase prior to testing, which is to say that reviews of requirements, functional specification, high-level design, low-level design and code have been performed prior to testing.
Assume that no requirements defects have been reported after the release of the product.
Which TWO of the following metrics do you need in order to evaluate the requirements reviews in terms of phase containment effectiveness?
Number of correct responses: 2
K32 credits
Reviews
You are a Test Manager working for a software organization where reviews have never been applied. After a meeting with your managers examining a business case for reviews, (including their costs, benefits, and potential issues), the management finally decides to adopt formal reviews for future projects.
You have been given a budget that you have spent to provide training in the review process and to introduce the review process on a pilot project.
On that pilot project the introduction of reviews has been very positive in terms of positive involvement from all the participants. All the reviews applied to different documents have been very effective for their purposes (especially at revealing defects).
Which of the following answers describes an important success factor for the introduction of formal reviews which is missing in this scenario?
Number of correct responses: 1
K43 credits
The main objectives the senior management team wants to achieve are:
- to reduce the costs associated with dynamic testing
- to use reviews to ensure that the project is on course for success and following the plan
- to use reviews as a well-documented and effective bug-removal activity following a formal process with well-defined roles
- to determine the effectiveness of reviews in terms of phase containment
- to improve phase containment effectiveness
Which of the following answers would you expect to describe the best way to achieve these objectives?
Number of correct responses: 1
K43 credits
During the follow-up phase the following conditions are checked:
X1. The code has been completely reviewed
X2. All the identified defects have been correctly fixed and the modified code has been compiled successfully and run through all the static analyzers used by the project without warnings and errors
X3. The modified code is available under the configuration management system with a new version number for the specified CI
If these conditions are fulfilled then the review process terminates.
Which of the following characteristics of a formal review is missing in this description?
Number of correct responses: 1
K21 credit
Improving the Testing Process
Which of the following statements about the TMMi test process improvement model is true?
Number of correct responses: 1
K21 credit
Defect Management
Which of the following information would you expect to be the most useful to perform a defect clustering analysis?
Number of correct responses: 1
K21 credit
Defect Management
Assume you are working on a defect management process to be used by a software organization to track the current status of the defects reports for several projects.
When a defect is found for investigation a defect report is created in “Opened” state that is the unique initial state. The defect report status has also a unique finale state that is the “Closed” state.
The following state transition diagram describes the states of this defect management process:
where only the initial (“Opened”) and final (“Closed”) states are indicated while the remaining states (V, W, X, Y, Z) have yet to be named.
Which of the following assignments would you expect to best complete the defect management process?
Number of correct responses: 1
K32 credits
Defect Management
During the system testing phase a tester from your test team observes a failure in the system under test and he/she decides to create an incident report. The incident report is currently in a “new” state, indicating it needs to be investigated.
Which THREE of the following information items can’t yet be present in the incident report?
Number of correct responses: 3
K32 credits (2 credits out of 3 credits correct, 1 credit point)
Defect Management
Consider a defect report and assume that a part of its lifecycle includes the following states:
New: Is the initial state
Working: Means that the developers are addressing the defect in order to produce a fix for the defect
Clarification: Means that the developers need more information from the tester to address the defect and produce a fix for the defect and the tester is working to provide this information to the developers
Verification: Means that a fix for the defect has been produced and the tester is running the adequate tests to verify whether the fix solves the defect
Closed: is the final state
Which of the following answers represents an invalid sequence of states that can’t lead the bug report to the “Closed” state?
Number of correct responses: 1
K21 credit
Your organization is considering using open-source tools. You have been told you need to be aware of the terms of the GNU general public license.
What is the basic concept of this license? [1]
Most managers in your company consider the efforts of your test team valuable, while others see comprehensive testing as an unnecessary cost overhead to the SDLC.
What action could the Test Manager take to quantify the value of testing to the organization? [3]
People Skills – Team Composition
Which of the following would you expect to be most likely an example of a demotivating factor for testers?
Number of correct responses: 2
K21 credit
You are using this skills assessment spreadsheet in order to define a training development plan for your test team.
Your objective is to fill the skill gaps by having at least a team member rated as an expert for each skill identified for the “technical expertise” and “testing skills” sections, and with the ability to train the other team members.
Considering the budget constraints you can send only one person to a training course.
Based only on the given information, which of the following answers would you expect to be the best option to achieve your objective?
Number of correct responses: 1
K43 credits
People Skills – Team Composition
An agile development team decides to hire a tester who has always worked:
- in independent test teams, reporting the problems found in a defect tracking system
- in safety-critical projects, with a stronger focus on the quality of the product than on time and budget.
This agile team is focused on short-term goals to get the product released on time and within budget.
Which of the following answers would you expect to be most likely true in this scenario?
Number of correct responses: 1
K21 credit
People Skills – Team Composition
Assume you are managing the system testing execution phase of a project.
The system test execution period for that project is scheduled for eighteen weeks and the release date is scheduled at the end of system testing.
During the sixth week of system test execution, at the staff meeting, the project manager informs you that the project deadlines are changed and the release date that is only three weeks ahead.
This new release will not allow the completion of the system tests. Suppose also that you have followed a risk-driven test approach for this project.
Which of the following statements represents the worst way to lead your test team in the next three weeks?
Number of correct responses: 1
K21 credit
People Skills – Team Composition
Which of the following would you expect to be most likely an example of a motivating factor for testers?
Number of correct responses: 1
K21 credit
Test Tools and Automation
Assume you are the Test Manager in charge of independent testing for avionics applications.
You are in charge of testing for a project to implement three different CSCI (Computer Software Configuration Item):
- a BOOT-X CSCI that must be certified at level B of the DO-178B standard
- a DIAG-X CSCI that must be certified at level C of the DO-178B standard
- a DRIV-X CSCI that must be certified at level A of the DO-178B standard
These are three different software modules written in C language to run on a specific hardware platform.
You have been asked to select a single code coverage tool to perform the mandatory code coverage measurements, in order to meet the structural coverage criteria prescribed by the DO-178B standard. This tool must be qualified as a verification tool under DO-178B.
Since there are significant budget constraints to purchase this tool, you are evaluating an open-source tool that is able to provide different types of code coverage. This tool meets perfectly your technical needs in terms of the programming language and the specific hardware platform (it supports also the specific C-compiler).
The source code of the tool is available.
Your team could easily customize the tool to meet the project needs. This tool is not qualified as a verification tool under the DO-178B.
Which of the following are the three main concerns related to that open-source tool selection?
Number of correct responses: 3
K43 credits (2 credits out of 3 credits correct, 1 credit point)
Test Tools and Automation
In your organization the following tools of the same vendor are currently in use: a requirements management tool, a test management tool and a bug tracking tool.
You are the Test Manager.
You are currently evaluating a test automation tool of the same vendor (to complete the vendor's tool suite) against an interesting open-source test automation tool under the GNU GPL (General Public License).
There are no initial costs associated to that open-source tool.
Which of the following statements associated to the selection of the open-source tool is correct in this scenario?
Number of correct responses: 1
K21 credit
Test Tools and Automation
Assume you are a Test Manager involved in system testing of a CRM application for a Pay-TV company. Currently the application is able to support a proper number of users assuring the required responsiveness. Since the business is expected to grow, you have been asked to evaluate the ability of the application to grow to support more users while maintaining the same responsiveness.
Which of the following tools would you expect to be the most useful at performing this evaluation?
Number of correct responses: 1
K21 credit
Test Tools and Automation
Assume you are managing a test automation project for a mission-critical system.
Because vendor provided tools and open source solutions don't meet the needs of this project, you ask your test team to develop a custom automation framework.
Which of the following management issues associated to the development of this custom automation framework is least likely to manage?
Number of correct responses: 1
K21 credit
Test Tools and Automation
After a selection process you have selected a test management tool that is going be introduced in your organization and used by your test team in a pilot project.
You have already identified the member of your test team who will be the administrator of the tool, since he/she has a significant experience with the administration of test management tools and so he/she is able to make effective and efficient up-front decisions about "how" the tool will be used. You have also developed a training plan for the other members of your test team.
In collaboration with the administrator of the tool you have also devised standard ways of managing, storing and maintaining the tool and its assets including backup/restore procedures.
You have also analyzed standard formats supported by the tool (CSV, XLS, XML, etc.) to export, import and archive all the information managed by the tool itself (requirements, test case specifications, test plans etc.) for compliance with the most important test management tools, in order to minimize the impacts of migrating this information to a new tool that could replace the existing one in the future.
Which of the following phases in the lifecycle of the new tool has NOT been adequately considered in this description?
Number of correct responses: 1
K21 credit
The following is the unique “critical” quality risk item that has been identified:
CR-RSK-1. The GUI of the application might accept non-integer values for the input field designed to get the number of bottles from the user
Test analysis for system testing has just begun and the following test conditions have been identified:
TC-SEL-2. Test the selection of the package sizes
TC-SEL-4. Test wrong numbers of bottles for an order
TC-CR-RSK-1. Test the accepted values from the input field designed to get the number of bottles from the user
What is the MINIMUM number of test conditions that must be added to fulfill both the EXCR1 and EXCR2 exit criteria?
Number of correct responses: 1
K32 credits
The following is the unique “critical” quality risk item that has been identified:
CR-RSK-1. The GUI of the application might accept non-integer values for the input field designed to get the number of bottles from the user
Test analysis for system testing has just begun and the following test conditions have been identified:
TC-SEL-2. Test the selection of the package sizes
TC-SEL-4. Test wrong numbers of bottles for an order
TC-CR-RSK-1. Test the accepted values from the input field designed to get the number of bottles from the user
Assume that you have used traceability to determine the logical test cases that cover all the requirements and the single risk item identified in that scenario.
Which of the following is a positive logical test that is complete and correct, and covers the REQ-SEL-4 requirement?
Number of correct responses: 1
K32 credits
Testing Process
The following are the exit criteria described in the test plan of a software product:
EX1. The test suite for the product must ensure that at least each quality risk item is covered by at least one test case (a quality risk item can be covered by more test cases).
EX2. All test cases in the test suite must be run during the execution phase.
EX3. Defects are classified into two categories: “C” (critical defect) and “NC” (non-critical defect). No known C defects shall exist in the product at the end of the test execution phase.
Which of the following information is useless when the specified exit criteria is evaluated?
Number of correct responses: 1
K21 credit
Testing Process
Which of the following is an example of the test closure activity indicated as "lessons learned"?
Number of correct responses: 1
K21 credit
The following are the requirements identified as “critical”:
REQ-SEL-001. The user shall be able to combine all the three products with all the four durations to define an item to purchase
REQ-SEL-002. The user shall be able to add a maximum of six different items to the shopping cart
REQ-PUR-001. The user shall be able to purchase all the items in the shopping cart using a credit voucher
REQ-PUR-002. The user shall be able to purchase all the items in the shopping cart using the available credit already charged on the smartcard
REQ-PUR-003. The user shall be able to purchase all the items in the shopping cart using all the accepted credit cards (Visa, MasterCard and Great Wall Card)
REG-LOGO-001. The user shall be able to logout (by clicking the logout button) from both the “select” and “purchase” pages going back to the “browse” page (anonymous navigation)
Moreover the following quality risk item has been identified as “critical”:
QR-P1. The web customer portal might not be able to provide the expected response time (less than 10 sec) for the purchase transactions under a load of up-to 1000 concurrent users
Test analysis for system testing has just begun and the following test conditions have been identified:
TC-SEL-01. Test the combinations of products and durations to define an item to purchase
TC-SEL-02. Test the maximum number of items, which can be added to the shopping cart
TC-PUR-01. Test the purchase of an item
TC-PUR-02. Test the purchase of an item with the credit charged on the smartcard
Assume that you have used traceability to determine the logical test cases that cover all the requirements and the single risk item identified in that scenario.
Which of the following is a positive logical test that is complete, is correct, and covers the REG-LOGO-001 requirement?
Number of correct responses: 1
K32 credits