SUT Factors Influencing TA
You have been assigned to implement test automation for a system that has the following capabilities:
• Receives messages from hardware devices
• Processes the error messages according to a rules engine
• Sends email to the designated system administrator with recommendations for
updates/changes to the hardware device or its settings
You have been looking at test automation alternatives and have found that you can automate
generating messages, receiving messages and processing the messages through the rules engine.
The company has invested a large amount of money into a test automation tool, but the tool is not
capable of getting the email from the email server and verifying that the recommendation is correct.
You are seeking a complete automation solution. What should you do?
a. Look for a new tool that can accomplish all the necessary tasks
b. Look for a complementary tool that will be able to handle the email validation
c. Verify that the rule processing is correct and assume that the email will be prepared correctly
d. Manually verify the emails by having them sent to your email address
(3 pts) Select ONE option.
b. Look for a complementary tool that will be able to handle the email validation
Test Automation Engineer will be
a. Primary responsable for the tool selection and evaluation process
b. Involved in supplying information and conducting many of the evaluation and selection activities.
b. Involved in supplying information and conducting many of the evaluation and selection activities.
Design for testability can also benefit?
Manual test execution
You are working on a project that is integrating internally-developed software with third-party software.
The third-party software provides an extensive accounting package that will be used for all facets of the company. The internally-developed software is a point-of-sale product that will be used by the retail stores of the company. The communication between the two products is done via batch files and APIs.
The reporting capabilities of the accounting package will be used by your company and are expected to provide the information necessary for budgeting decisions.
Given this information, what is the most appropriate automation approach for testing the third-party system?
a. No test automation is needed because it should already have been tested by the third-party developers
b. Testing should be limited to only testing the reporting capability of the accounting package because that is the most critical software to your company
c. Testing should concentrate on the API being used to pass data to the third-party package to ensure the data is handled correctly
d. Batch file preparation testing should be conducted on the point-of-sale product to ensure the proper data is included in the batch files
(3 pts) Select ONE option.
c. Testing should concentrate on the API being used to pass data to the third-party package to ensure the data is handled correctly
At least 3 activities of the TAE for evaluating and selecting tools
a. Analyzing tool information against objectives and project constraints, Estimating the cost-benefit ratio based on a solid business case. Identifying compatibility of the tool with SUT components
b. Implementing and evolving appropriate measurements and metrics. Planning, deploying and managing the testing effort for any given engagement/release. Retaining skilled testing personnel.
c. Planning the development and evolution of a test automation solution. Supervision of the development and evolution of a test automation solution. Risk management
a. Analyzing tool information against objectives and project constraints, Estimating the cost-benefit ratio based on a solid business case. Identifying compatibility of the tool with SUT components
When a system is designed for testability, one of the characteristics is that the test cases can access interfaces into the system that can be used to verify the expected behavior actually occurred as a result of the test.
What is this characteristic called?
a) Observability
b) Controllability
c) Maintainability
d) Interoperability
(1 pt) Select ONE option.
a) Observability
You have been automating a legacy application that provides critical functionality to the business.
An update to the legacy system has been approved and the developers plan to use third party software to provide the new functionality. The third party software has already been tested but the interface between the existing software and the new software is problematic. Your existing test automation needs to be extended to test the interface between these two products.
How should you approach implementing the best automation solution?
a) Develop test automation for the entire system including the legacy and third party
applications
b) Investigate if automation is possible via the APIs used to interface with the third party software
c) Develop new automation to test via the GUI of the third party software
d) Investigate if automation can be implemented using the CLI to replace the existing GUI
automation
(3 pts) Select ONE option.
b) Investigate if automation is possible via the APIs used to interface with the third party software
You are evaluating functional test automation tools. The tool that you prefer can provide your organization with a favorable cost-benefit ratio, which appeals to senior management. Additionally, you feel the tool is superior in meeting your other technical criteria. However, the tool has many features most of which will never be used. As a result, you feel this makes the tool overly complex and confusing.
What should your next steps be regarding selection of this tool?
a) Consider another tool that is more user friendly
b) Explore the possibility of configuring the tool to turn off unnecessary features
c) Plan to supplement selection of this tool with lengthy and comprehensive training sessions
d) Consider acquiring an additional tool that can provide a more user friendly interface to the preferred tool
(3 pts) Select ONE option.
b) Explore the possibility of configuring the tool to turn off unnecessary features
Which of the following are two of the important considerations when designing an SUT for testability?
a. Controllability and changeability
b. Changeability and maintainability
c. Maintainability and observability
d. Observability and controllability
(1 pt) Select ONE option.
d. Observability and controllability
You are deciding on the functional test automation approach for a highly complex system which is expected to be used in production for many years. You have already conducted a survey with the major tool vendors and you have determined that you will not be able to use any of their tools to create your test automation due to the non-standard interfaces that were required for the software.
You and the developers have decided that your best automation approach will be through custom interfaces implemented specifically for testing.
What are two concerns you should have with this approach?
a) If the interfaces are not disabled before release, there could be a security risk
b) The performance of the test interfaces may be much faster than the performance of the real interfaces
c) The effort spent to develop test automation will not be justified by the expected lifespan of the code in production
d) Because there is a high level of intrusion, there may be false alarms generated
e) Because there is a low level of intrusion, the test results will not be representative of the production code
(3 pts) Select TWO options.
a) If the interfaces are not disabled before release, there could be a security risk
d) Because there is a high level of intrusion, there may be false alarms generated
You have been working with your company’s standard test automation tool on a new mobile application developed in-house. This tool has been used for the last several years and supports the test automation for 20 major applications including five other mobile applications. The new application has a friendly UI but uses a table object that your tool cannot recognize. As a result, you have no way of verifying that the data shown in the table is correct. What is the first thing you should do about this problem?
a. See if the application can be run on a desktop and if the table can be recognized when the application is used on the desktop
b. Conduct a pilot test across a sample of industry leading tools to see if the object can be recognized
c. Ask the developers to remove the table object and replace it with a set of text fields
d. Ask the developers to change the table object to a standard table object that could be recognized by the tool
(3 pts) Select ONE option.
d. Ask the developers to change the table object to a standard table object that could be recognized by the tool
Which of the following is an important consideration when designing an SUT for automation?
a. Compatibility with existing automation tools
b. Controllability by the operator
c. Maintainability by the developers
d. Changeability using existing automation tools
(1 pt) Select ONE option.
a. Compatibility with existing automation tools