Intermediate user level|
Understand the "art and science” of performance testing
Interpret results and investigate failures and defects
Recognize patterns and discern the cause-effect relationships between the components that make up the system
After a circuitous route into IT, Keith Yorkston has spent the last 20 years involved with software quality and risk. Cutting his teeth early in performance testing before good books were written on the subject, Keith went on to work as a consultant and trainer across the world. He currently works as an independent consultant specializing in performance and security.
Use this book to prepare for the ISTQB
® Certified Tester Foundation Level Performance Testing exam. The book has been designed to follow the ISTQB syllabus, covering all of the syllabus learning objectives, with additional reference material extending beyond the syllabus. The book covers an overall methodology for managing and conducting performance testing.
Performance testing has often been considered a black art. In many organizations, perhaps an individual or a small group of technical staff or contractors is given the task of "load testing” an extended system, network, or application.
Performance testing is like any other form of testing. It follows a defined test process that is similar to other test types. It utilizes a disciplined approach to the definition of requirements and user stories, the creation of test conditions, test cases, and test procedures. It establishes measurable goals against which the success or failure of the testing can be judged. It also requires (and this cannot be stressed highly enough) a definition and recognition of performance test failures.
Readers will gain the knowledge with both content and practice questions to prepare them for the ISQTB Performance Testing exam. The book covers the performance test types, the performance testing methodology, and the steps to plan, create, and execute performance tests and analyze the results.
What You Will Learn
- Understand the basic concepts of performance efficiency and performance testing
- Define performance risks, goals, and requirements to meet stakeholder needs and expectations
- Understand performance metrics and how to collect them
- Develop a performance test plan for achieving stated goals and requirements
- Conceptually design, implement, and execute basic performance tests
- Analyze the results of a performance test and communicate the implications to stakeholders
- Explain the process, rationale, results, and implications of performance testing to stakeholders
- Understand the categories and uses for performance tools and criteria for their selection
- Determine how performance testing activities align with the software life cycle
Who This Book Is For
Those who want to achieve the ISTQB performance testing certification, testers and test managers who want to increase their performance testing knowledge, and project managers/staff working with performance testing in their project for the first time
Introduction
Chapter 1. The Basic Concepts of Performance Testing
ISTQB® Keywords
Other Keywords
1.1 Principles of Performance Testing
1.2 Types of Performance Testing
Performance Testing
Load Testing
Stress Testing
Scalability Testing
Spike Testing
Endurance Testing
Concurrency Testing
Capacity Testing
1.3 Testing Activities in Performance Testing
Static Testing
Dynamic Testing
1.4 The Concept of Load Generation
Load Generation via the User Interface
Load Generation Using Crowds
Load Generation via the Application Programming Interface (API)
Load Generation using Captured Communication Protocols
1.5 Common Performance Efficiency Failure Modes and Their Causes
Chapter 1 Questions
Chapter 2. Performance Measurement Fundamentals
ISTQB® Keywords
Other Keywords
2.1 Typical Measurements Collected in Performance Testing
Why Performance Metrics Are Needed
Collecting Performance Measurements and Metrics
Selecting Performance Metrics
2.2 Aggregating Results from Performance Testing
2.3 Key Sources of Performance Metrics
2.4 Typical Results of a Performance Test
Chapter 2 Questions
Chapter 3. Performance Testing in the Software Lifecycle
ISTQB® Keywords
3.1 Principal Performance Testing Activities
3.2 Categories of Performance Risks for Different Architectures
Single Computer Systems
Multi-tier Systems
Distributed Systems
Virtualised Systems
Dynamic/Cloud-based Systems
Client –Server Systems
Mobile Applications
Embedded Real-time Systems
Mainframe Applications
3.3 Performance Risks Across the Software Development Lifecycle
3.4 Performance Testing Activities
Sequential Development Models
Iterative and Incremental Development Models
Commercial Off-the-Shelf (COTS) and other Supplier/Acquirer Models
Chapter 3 Questions
Chapter 4. Performance Testing Tasks
ISTQB® Keywords
4.1 Planning
4.1.1 Deriving Performance Test Objectives
4.1.2 The Performance Test Plan
4.1.3 Communicating about Performance Testing
4.2 Analysis, Design and Implementation
4.2.1 Typical Communication Protocols
4.2.2 Transactions
4.2.3 Identifying Operational Profiles
4.2.4 Creating Load Profiles
4.2.5 Analysing Throughput and Concurrency
4.2.6 Basic Structure of a Performance Testillegalscript
4.2.7 Implementing Performance Testillegalscripts
4.2.8 Preparing for Performance Test Execution
4.3 Execution
4.4 Analysing Results and Reporting
Analysis Techniques
Reporting
Chapter 4 Questions
Chapter 5. Tools
ISTQB® Keywords
5.1 Tool Support
5.2 Tool Suitability
Chapter 5 Questions
Chapter 6. References
6.1 Standards
6.2 ISTQB® Documents
6.3 Books
6.4 Papers and Articles
Chapter 7. Question Answers
7.1 Chapter 1
7.2 Chapter 2
Use this book to prepare for the ISTQB
® Certified Tester Foundation Level Performance Testing exam. The book has been designed to follow the ISTQB syllabus, covering all of the syllabus learning objectives, with additional reference material extending beyond the syllabus. The book covers an overall methodology for managing and conducting performance testing.
Performance testing has often been considered a black art. In many organizations, perhaps an individual or a small group of technical staff or contractors is given the task of "load testing” an extended system, network, or application.
Performance testing is like any other form of testing. It follows a defined test process that is similar to other test types. It utilizes a disciplined approach to the definition of requirements and user stories, the creation of test conditions, test cases, and test procedures. It establishes measurable goals against which the success or failure of the testing can be judged. It also requires (and this cannot be stressed highly enough) a definition and recognition of performance test failures.
Readers will gain the knowledge with both content and practice questions to prepare them for the ISQTB Performance Testing exam. The book covers the performance test types, the performance testing methodology, and the steps to plan, create, and execute performance tests and analyze the results.
You will:
- Understand the basic concepts of performance efficiency and performance testing
- Define performance risks, goals, and requirements to meet stakeholder needs and expectations
- Understand performance metrics and how to collect them
- Develop a performance test plan for achieving stated goals and requirements
- Conceptually design, implement, and execute basic performance tests
- Analyze the results of a performance test and communicate the implications to stakeholders
- Explain the process, rationale, results, and implications of performance testing to stakeholders
- Understand the categories and uses for performance tools and criteria for their selection
- Determine how performance testing activities align with the software life cycle
Use this book to prepare for the ISTQB
® Certified Tester Foundation Level Performance Testing exam. The book has been designed to follow the ISTQB syllabus, covering all of the syllabus learning objectives, with additional reference material extending beyond the syllabus. The book covers an overall methodology for managing and conducting performance testing.
Performance testing has often been considered a black art. In many organizations, perhaps an individual or a small group of technical staff or contractors is given the task of "load testing" an extended system, network, or application.
Performance testing is like any other form of testing. It follows a defined test process that is similar to other test types. It utilizes a disciplined approach to the definition of requirements and user stories, the creation of test conditions, test cases, and test procedures. It establishes measurable goals against which the success or failureof the testing can be judged. It also requires (and this cannot be stressed highly enough) a definition and recognition of performance test failures.
Readers will gain the knowledge with both content and practice questions to prepare them for the ISQTB Performance Testing exam. The book covers the performance test types, the performance testing methodology, and the steps to plan, create, and execute performance tests and analyze the results.
What You Will Learn
- Understand the basic concepts of performance efficiency and performance testing
- Define performance risks, goals, and requirements to meet stakeholder needs and expectations
- Understand performance metrics and how to collect them
- Develop a performance test plan for achieving stated goals and requirements
- Conceptually design, implement, and execute basic performance tests
- Analyze the results of a performance test and communicate the implications to stakeholders
- Explain the process, rationale, results, and implications of performance testing to stakeholders
- Understand the categories and uses for performance tools and criteria for their selection
- Determine how performance testing activities align with the software life cycle
Who This Book Is For
Those who want to achieve the ISTQB performance testing certification, testers and test managers who want to increase their performance testing knowledge, and project managers/staff working with performance testing in their project for the first time
Introduction.- Chapter 1. The Basic Concepts of Performance Testing.- Chapter 2. Performance Measurement Fundamentals.- Chapter 3. Performance Testing in the Software Lifecycle.- Chapter 4. Performance Testing Tasks.- Chapter 5. Tools.- Chapter 6. References.- Chapter 7. Question Answers.
Über den Autor
After a circuitous route into IT, Keith Yorkston has spent the last 20 years involved with software quality and risk. Cutting his teeth early in performance testing before good books were written on the subject, Keith went on to work as a consultant and trainer across the world. He currently works as an independent consultant specializing in performance and security.
Inhaltsverzeichnis
Introduction
Chapter 1. The Basic Concepts of Performance Testing
ISTQB® Keywords
Other Keywords
1.1 Principles of Performance Testing
1.2 Types of Performance Testing
Performance Testing
Load Testing
Stress Testing
Scalability Testing
Spike Testing
Endurance Testing
Concurrency Testing
Capacity Testing
1.3 Testing Activities in Performance Testing
Static Testing
Dynamic Testing
1.4 The Concept of Load Generation
Load Generation via the User Interface
Load Generation Using Crowds
Load Generation via the Application Programming Interface (API)
Load Generation using Captured Communication Protocols
1.5 Common Performance Efficiency Failure Modes and Their Causes
Chapter 1 Questions
Chapter 2. Performance Measurement Fundamentals
ISTQB® Keywords
Other Keywords
2.1 Typical Measurements Collected in Performance Testing
Why Performance Metrics Are Needed
Collecting Performance Measurements and Metrics
Selecting Performance Metrics
2.2 Aggregating Results from Performance Testing
2.3 Key Sources of Performance Metrics
2.4 Typical Results of a Performance Test
Chapter 2 Questions
Chapter 3. Performance Testing in the Software Lifecycle
ISTQB® Keywords
3.1 Principal Performance Testing Activities
3.2 Categories of Performance Risks for Different Architectures
Single Computer Systems
Multi-tier Systems
Distributed Systems
Virtualised Systems
Dynamic/Cloud-based Systems
Client -Server Systems
Mobile Applications
Embedded Real-time Systems
Mainframe Applications
3.3 Performance Risks Across the Software Development Lifecycle
3.4 Performance Testing Activities
Sequential Development Models
Iterative and Incremental Development Models
Commercial Off-the-Shelf (COTS) and other Supplier/Acquirer Models
Chapter 3 Questions
Chapter 4. Performance Testing Tasks
ISTQB® Keywords
4.1 Planning
4.1.1 Deriving Performance Test Objectives
4.1.2 The Performance Test Plan
4.1.3 Communicating about Performance Testing
4.2 Analysis, Design and Implementation
4.2.1 Typical Communication Protocols
4.2.2 Transactions
4.2.3 Identifying Operational Profiles
4.2.4 Creating Load Profiles
4.2.5 Analysing Throughput and Concurrency
4.2.6 Basic Structure of a Performance Testillegalscript
4.2.7 Implementing Performance Testillegalscripts
4.2.8 Preparing for Performance Test Execution
4.3 Execution
4.4 Analysing Results and Reporting
Analysis Techniques
Reporting
Chapter 4 Questions
Chapter 5. Tools
ISTQB® Keywords
5.1 Tool Support
5.2 Tool Suitability
Chapter 5 Questions
Chapter 6. References
6.1 Standards
6.2 ISTQB® Documents
6.3 Books
6.4 Papers and Articles
Chapter 7. Question Answers
7.1 Chapter 1
7.2 Chapter 2
Klappentext
Use this book to prepare for the ISTQB® Certified Tester Foundation Level Performance Testing exam. The book has been designed to follow the ISTQB syllabus, covering all of the syllabus learning objectives, with additional reference material extending beyond the syllabus. The book covers an overall methodology for managing and conducting performance testing.
n
Performance testing has often been considered a black art. In many organizations, perhaps an individual or a small group of technical staff or contractors is given the task of ¿load testing¿ an extended system, network, or application.nnnnPerformance testing is like any other form of testing. It follows a defined test process that is similar to other test types. It utilizes a disciplined approach to the definition of requirements and user stories, the creation of test conditions, test cases, and test procedures. It establishes measurable goals against which the success or failure of the testing can be judged. It also requires (and this cannot be stressed highly enough) a definition and recognition of performance test failures. nReaders will gain the knowledge with both content and practice questions to prepare them for the ISQTB Performance Testing exam. The book covers the performance test types, the performance testing methodology, and the steps to plan, create, and execute performance tests and analyze the results.nnnnnWhat You Will LearnnUnderstand the basic concepts of performance efficiency and performance testingnDefine performance risks, goals, and requirements to meet stakeholder needs and expectationsnUnderstand performance metrics and how to collect themnDevelop a performance test plan for achieving stated goals and requirementsnConceptually design, implement, and execute basic performance testsnAnalyze the results of a performance test and communicate the implications to stakeholdersnExplain the process, rationale, results, and implications of performance testing to stakeholdersnUnderstand the categories and uses for performance tools and criteria for their selectionnDetermine how performance testing activities align with the software life cyclennnn n nWho This Book Is FornnnThose who want to achieve the ISTQB performance testing certification, testers and test managers who want to increase their performance testing knowledge, and project managers/staff working with performance testing in their project for the first time
Understand the "art and science" of performance testing
Interpret results and investigate failures and defects
Recognize patterns and discern the cause-effect relationships between the components that make up the system
