Andreas Golze

Published in partnership with HP, this guide shares more than 20 years of software testing wisdom from both HP consultants and customers aimed at improving performance measurement. You’ll learn from the experts how to move through software development and testing processes in the most effective, cost-efficient way as you examine fundamental questions around testing from a business perspective: what to test and how to assure that testing has accomplished its objective, the various behavioral modeling methods, using key performance indicators, and more.

Acknowledgements.
Introduction.
Chapter 1 What Is the Big Deal About Testing?
Quality Goals and Test Phases.
Requirements Verification.
Unit Test.
Integration Test.
System Test.
Performance Test.
User Acceptance Test.
Operational Readiness Test.
Case Study: Flight Application.
Requirements Verification.
Unit Test.
Integration Test.
System Test.
Performance Test.
User Acceptance Test.
Operational Readiness Test.
Test Concepts and Techniques.
White-Box Testing.
Black-Box Testing.
Wrapping Up.
Chapter 2 Testing the Business Requirements: Start at the Root of the Problem.
Build a Common Reference.
Document the Separate Business Functions.
Link Requirements into the Structure.
Define Proof Points.
Chapter 3 Test Rules: Build the Backbone for Effective Testing.
Equivalence Partitioning with Root Cause Analysis.
Chapter 4 Test Cases: Let’s Get Down to the Real Stuff.
Step 1: Select a Test Rule.
Step 2: Specifying Master Data.
Take Data from Production.
Build Data Using the Existing Application.
Generate Data from Scratch.
Step 3: Finalize the Test Case Description.
Test Scenarios.
Test Execution.
Chapter 5 Test Optimization: Balancing Risk and Effort.
Risk Assessment.
Business Impact Analysis.
Failure Probability.
Derive Business Risk.
Test Procedure Definition.
Functional Complexity.
Test Effort Estimation.
How to Calculate the Optimal Level of Automation.
Test Effort Optimization.
Improving Test Automation and Manual Testing.
Improving Regression Test Efficiency.
Chapter 6 Why Bother with Non-Functional Testing?
Non-Functional Scope.
Performance.
Load.
Availability.
Reliability.
Consider Non-Functional Testing at the Business Level.
Performance Testing.
Step 1: Defining Performance Requirements.
Step 2: Performance Breakdown.
Step 3: Performance Instrumentation.
Step 4: Performance Test Execution.
Step 5: Performance Test Analysis.
Step 6: Performance Enhancements.
Load Testing.
Step 1: Stability.
Step 2: Load Support.
Step 3: Scalability.
Step 4: Sustainability.
Step 5: Overload.
Availability Testing.
Expressing Availability.
Turning Availability Rate into Concrete Terms.
High Availability Testing.
Reliability Testing.
Reliability Requirements.
Reliability Testing.
Non-Functional Testing Critical for Success.
Chapter 7 Application Security Testing: The Next Frontier.
Understanding the Application Security Problem.
The Technical Problem.
The Lifecycle Problem.
The Business Problem.
The Solution.
Enterprise Security Strategy and Policies.
Process and Practices.
Education and Training.
Key Stakeholders.
Technology.
Static Analysis (aka Source Code Analysis).
Dynamic Analysis (aka Black-Box Testing).
Hybrid Analysis.
Secure Code Libraries.
Continuously Updated Security Knowledge-Bases.
So Where Does That Leave Us?
Chapter 8 Test Sourcing: How Outsourcing Improves.
Cost Effective Testing.
Why — and How — Does Outsourcing Work in Other Industries?
Successful IT Outsourcing.
Step 1: Test Rule Definition.
Step 2: Test Data Specification.
Step 3: Data Load Procedures.
Step 4: Test Script Development.
Step 5: Compare Utility Development.
Step 6: Automated Test Evaluation.
Step 7: Manual Test Execution.
Step 8: Test Evaluation.
Chapter 9 SUCCESSFUL Goal-Driven KPI Approach.
Set Business Goals.
Understand the Impact of Each Department on Business Goals.
Choose Supporting Business Processes.
Create Business Process Goals.
Examine What to Measure.
Standardize Measurements Across Departments.
Scope Data Source and Integration Needs.
Formalize Indicators and Thresholds.
Utilize and Execute Appropriate Action Plans.
Lay the Groundwork and Baseline.
Chapter 10 Getting Started: Putting It All Together.
Level 0: Quality Agnostic.
Level 1: Quality Initializing.
Process Characteristics.
Product Characteristics.
People Characteristics.
Level 2: Quality Conscious.
Process Characteristics.
Product Characteristics.
People Characteristics.
Level 3: Quality Savvy.
Process Characteristics.
Product Characteristics.
People Characteristics.
Level 4: Quality Expert.
Process Characteristics.
Product Characteristics.
People Characteristics.
Self Evaluation — Designing a Roadmap.
Appendix A Common Test Techniques.
Appendix B HP Application Quality Management Solutions Introduction and Overview.
Appendix C Verification.
Appendix D Naming Conventions.
References.
Glossary.