ATM Sample Questions Answers

Which of the following factors could negatively influence a review?

K2 1 credit

You are a Test Manager working for a software organization where reviews have never been applied. After a meeting with your managers examining a business case for reviews, (including their costs, benefits, and potential issues), the management finally decides to adopt formal reviews for future projects.

You have been given a budget that you have spent to provide training in the review process and to introduce the review process on a pilot project.

On that pilot project the introduction of reviews has been very positive in terms of positive involvement from all the participants. All the reviews applied to different documents have been very effective for their purposes (especially at revealing defects).

Which of the following answers describes an important success factor for the introduction of formal reviews which is missing in this scenario?

K4 3 credits

Assume you are the Test Manager in charge of independent testing for avionics applications.

You are in charge of testing for a project to implement three different CSCI (Computer Software Configuration Item):

- a BOOT-X CSCI that must be certified at level B of the DO-178B standard

- a DIAG-X CSCI that must be certified at level C of the DO-178B standard

- a DRIV-X CSCI that must be certified at level A of the DO-178B standard

These are three different software modules written in C language to run on a specific hardware platform.

You have been asked to select a single code coverage tool to perform the mandatory code coverage measurements, in order to meet the structural coverage criteria prescribed by the DO-178B standard. This tool must be qualified as a verification tool under DO-178B.

Since there are significant budget constraints to purchase this tool, you are evaluating an open-source tool that is able to provide different types of code coverage. This tool meets perfectly your technical needs in terms of the programming language and the specific hardware platform (it supports also the specific C-compiler).

The source code of the tool is available.

Your team could easily customize the tool to meet the project needs. This tool is not qualified as a verification tool under the DO-178B.

Which of the following are the three main concerns related to that open-source tool selection?

K4 3 credits (2 credits out of 3 credits correct, 1 credit point)

Consider the following skills assessment spreadsheet for your test team (consisting of four team members):

This spreadsheet has three sections: technical expertise, testing skills and professionalism.

The skill levels for each skill area for both the “technical expertise” and “testing skills” sections have been rated on a four-point scale:

- E (Expert): indicates that a person has expert knowledge and experience in the skill area

- B (Beginner): indicates that a person has some knowledge and experience in the skill area but he/she is not autonomous

- W (Wants to learn): indicates that a person has no knowledge or experience in the skill area but he/she wants to learn that skill

- NI (Not Interested): indicates that a person has no knowledge or experience in the skill area and he/she is not interested to learn that skill

The skill levels for each skill area of the “professionalism” section have been rated on a three point scale (H=High, M=Medium, L=Low).

Consider the following analysis of testing skills performed on four peoplE. Alex, Robert, John and Mark (all the skills have been rated on an ascending scalE. The higher the score, the better the skill):

Which of these people, based on this analysis, would you expect to be most suitable to work specifically as test designer?

K4 3 credits

Assume you are managing the system testing execution phase of a project.

The system test execution period for that project is scheduled for eighteen weeks and the release date is scheduled at the end of system testing.

During the sixth week of system test execution, at the staff meeting, the project manager informs you that the project deadlines are changed and the release date that is only three weeks ahead.

This new release will not allow the completion of the system tests. Suppose also that you have followed a risk-driven test approach for this project.

Which of the following statements represents the worst way to lead your test team in the next three weeks?

K2 1 credit

An agile development team decides to hire a tester who has always workeD.

- in independent test teams, reporting the problems found in a defect tracking system

- in safety-critical projects, with a stronger focus on the quality of the product than on time and budget.

This agile team is focused on short-term goals to get the product released on time and within budget.

Which of the following answers would you expect to be most likely true in this scenario?

K2 1 credit

Which of the following statements about the STEP test process improvement model is true?

K2 1 credit

After the presentation, you are asked to explain the chart.

Assume you have applied a full risk-based testing strategy.

Which of the following answers would you expect to best describe the pie chart?

K4 3 credits

A chart showing the trend in the lag time from defect reporting to resolution during system testing is also available. The chart shows that the daily closure period is consistently and significantly above the rolling closure period for a long period of the system testing phase.

Almost all defects found during system testing have been related to the system as a whole, not related to single units or integrations issues. Almost all quality risks have been addressed during the unit and integration testing phase and no residual quality risks were present in the integrated system. This has been confirmed by exploratory testing sessions performed during system testing, targeted at finding defects in these quality risk areas.

Based on the given information only, which one of the following areas would you expect to be considered more in the retrospective meeting in order to be improved?

K3 3 credits

Assume that you are the Test Manager for a small insurance application development project.

You have decided to adopt a risk-based testing strategy: 5 product risks (R1, R2, R3, R4, R5) have been identified and their levels of risk have been assessed. 10 test cases (T1, …, T10) have been designed to cover all the product risks.

The following table shows the risk level and the test cases associated to the identified product risks (higher risk level means higher risk):

You are not confident with the assessment of the risk level and you suspect that it will be possible to find high-priority bugs in low-risk areas.

Furthermore the period for test execution is very short. Your goal is to test all the product risks in a risk-based way, while assuring that each product risk gets at least some amount of testing.

Which of the following answers describes the best test execution schedule in this scenario?

K3 2 credits

The following are the requirements identified as “critical”:

REQ-SEL-001. The user shall be able to combine all the three products with all the four durations to define an item to purchase

REQ-SEL-002. The user shall be able to add a maximum of six different items to the shopping cart

REQ-PUR-001. The user shall be able to purchase all the items in the shopping cart using a credit voucher

REQ-PUR-002. The user shall be able to purchase all the items in the shopping cart using the available credit already charged on the smartcard

REQ-PUR-003. The user shall be able to purchase all the items in the shopping cart using all the accepted credit cards (Visa, MasterCard and Great Wall Card)

REG-LOGO-001. The user shall be able to logout (by clicking the logout button) from both the “select” and “purchase” pages going back to the “browse” page (anonymous navigation)

Moreover the following quality risk item has been identified as “critical”:

QR-P1. The web customer portal might not be able to provide the expected response time (less than 10 sec) for the purchase transactions under a load of up-to 1000 concurrent users

Test analysis for system testing has just begun and the following test conditions have been identifieD.

TC-SEL-01. Test the combinations of products and durations to define an item to purchase

TC-SEL-02. Test the maximum number of items, which can be added to the shopping cart

TC-PUR-01. Test the purchase of an item

TC-PUR-02. Test the purchase of an item with the credit charged on the smartcard

What is the MINIMUM number of test conditions that must be added to fulfill both the EXCR1 and EXCR2 exit criteria?

K3 2 credits

You are the Test Manager for a project to develop a client-server application that allows wine vendors to order custom-assorted packages of wines of several winemakers to sell special packages in their wine shops.

You decide to apply a blended risk-based and reactive testing strategy. Below the exit criteria for the system testinG.

EXCR1- Each “critical” quality risk item must be covered by at least one test condition

EXCR2- Each “critical” requirement must be covered by at least one test condition

The following are the “critical” requirements of the application:

REQ-SEL-1. The application shall allow the user to order only one package at a time

REQ-SEL-2. The application shall allow the user to select between four different packages (2-bottles, 6-bottles, 12-bottles, 15-bottles)

REQ-SEL-3. The application shall allow the user to order a package containing at least 1 bottle and no more bottles than the package size. No error messages shall be displayed if the user selects a valid number of bottles (at least 1 bottle and no more than the package size)

REQ-SEL-4. The application shall display an error message “Invalid number of bottles” if an invalid number of bottles is selected by the user (zero bottles or a number higher than the package size)

REQ-PAY-1. The application shall allow the user to pay with the three accepted credit cards (Visa, MasterCard, American Express)

REQ-PAY-2. The application shall display an error message “Invalid credit card” if invalid credit card data are given by the user

The following is the unique “critical” quality risk item that has been identified:

CR-RSK-1. The GUI of the application might accept non-integer values for the input field designed to get the number of bottles from the user

Test analysis for system testing has just begun and the following test conditions have been identified.

TC-SEL-2. Test the selection of the package sizes

TC-SEL-4. Test wrong numbers of bottles for an order

TC-CR-RSK-1. Test the accepted values from the input field designed to get the number of bottles from the user

What is the MINIMUM number of test conditions that must be added to fulfill both the EXCR1 and EXCR2 exit criteria?

K3 2 credits

Consider a defect report and assume that a part of its lifecycle includes the following states:

New: Is the initial state

WorkinG. Means that the developers are addressing the defect in order to produce a fix for the defect Clarification: Means that the developers need more information from the tester to address the defect and produce a fix for the defect and the tester is working to provide this information to the developers Verification: Means that a fix for the defect has been produced and the tester is running the adequate tests to verify whether the fix solves the defect

CloseD. is the final state

Which of the following answers represents an invalid sequence of states that can’t lead the bug report to the “Closed” state?

K2 1 credit

Which of the following information would you expect to be the most useful to perform a defect clustering analysis?

K2 1 credit

Assume you are working on a defect management process to be used by a software organization to track the current status of the defects reports for several projects.

When a defect is found for investigation a defect report is created in “Opened” state that is the unique initial state. The defect report status has also a unique finale state that is the “Closed” state.

The following state transition diagram describes the states of this defect management process:

Where only the initial (“Opened”) and final (“Closed”) states are indicated while the remaining states (V, W, X, Y, Z) have yet to be named.

Which of the following assignments would you expect to best complete the defect management process?

K3 2 credits

You are the Test Manager of a new project that will have three formal levels of testinG. unit, integration and system testing. The testing strategy you decide to adopt a blend of risk-based testing and reactive testing strategies.

Which of the following answers describes the most consistent example of implementation of this test strategy during the execution of the system tests?

K2 1 credit