Thursday, October 31, 2013

Test Automation

Test Automation

  • Continuous integration - Testing after every commit.
  • Smoke testing - after we receive new build we check the basic functionality.
  • Waterflow model - the QA process is not part of the code creation project.
  • Regression testing - after bug is fixed

Which tasks:
- Tedious
Such as regression testing
- Difficult to do manually Such as performance testing

Test tools improve testing consistency and repeatability. Tests can be executed in the same order with the same frequency.
Test Tool Concepts
  • support testing
  • help in managing the testing process
  • Automate activities that can not be executed manually
  • Increase reliability of testing

Test Automation Risks
- Unrealistic expectations for the tool
- Make sure people have proper expectations
- Underestimating the time, cost, and effort required to introduce the tool
- Underestimating the time and effort needed to achieve a positive return on investment
- Underestimating the effort required to maintain the tests
Test Automation Strategiesdefine the ways and means for proper and effective usage of tools.
- Think What You Automate
- Automate for the Long Term
- Automate What You’ll Use
- Automate What a Human Won’t Do Well

Goals of Test Automation 
Tests should
- Help us improve quality
- Help us understand the SUT
- Reduce risk
- Be easy to run
- Be easy to write
- Require minimal maintenance as the system evolves around them
- Keep the tests short
- Keep tests independent
- Tests can be executed over and over again and with the same results
- A test is non-deterministic when it passes sometimes and fails sometimes, without any noticeable change in the code, tests, or environment
Keyword-Driven Test Automation
Sequences of keywords (including relevant test data) are used to specify test cases.
Performance Testing Tools
Performance test tools have two main facilities:
- Load generation
Load generation can simulate either multiple users or high volumes of input data
- Measurement and analysis of system response to a given load
Normally provide reports based on test logs and graphs of load against response times

No comments:

Post a Comment