软件测试：原理与实践

本书的内容基于爱尔兰国立大学梅努斯和浙江大学的一系列课程讲稿。该书覆盖了软件测试的基本原理和主要方法，可以作为软件测试全英课程或双语课程的教材。

Prefaceii
1 Introduction1
1.1 The Software Industry1
1.1.1 Software Testing and Quality2
1.1.2 Software Testing and Risk Management3
1.2 Mistakes, Faults and Failures3
1.2.1 Software Faults4
1.2.2 Software Failures5
1.2.3 Need for Testing6
1.3 The Role of Specifications8
1.4 Overview of Testing9
1.4.1 Testing in the Development Process9
1.4.2 Test Automation9
1.5 The Theory of Testing10
1.5.1 Exhaustive Testing Example11
1.5.2 Implications11
1.5.3 When To Finish Testing12
1.6 Book Structure13
1.6.1 Order of Testing14
1.6.2 Programming Language14
1.6.3 Level of Detail14
1.6.4 Code Examples14
1.7 Notes on Terminology14
2 Principles of Software Testing15
2.1 Static Verification15
2.1.1 Walk-throughs16
2.1.2 Code Reviews/Inspections16
2.1.3 Formal Methods and Testing18
2.2 Dynamic Verification19
2.3 Black-Box and White-Box Testing19
2.3.1 Errors of “Omission” and “Commission” 21
2.4 Test Approaches22
2.4.1 Black-Box Testing22
2.4.2 White-Box Testing23
2.4.3 Fault Insertion24
2.5 Test Design Process24
2.5.1Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
2.5.2Generating Test Cases . . . . . . . . . . . . . . . . . . . . . . . . . 25
2.5.3Generating Test Data . . . . . . . . . . . . . . . . . . . . . . . . . 26
2.5.4Implementing Tests . . . . . . . . . . . . . . . . . . . . . . . . . . 26
2.6 Analysis of Software Specifications . . . . . . . . . . . . . . . . . . . . . . 27
2.6.1Parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
2.6.2Parameter Ranges . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
2.6.3Equivalence Partitions . . . . . . . . . . . . . . . . . . . . . . . . . 28
2.6.4Boundary Values . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
2.6.5Combinations of Values . . . . . . . . . . . . . . . . . . . . . . . . 30
2.6.6Sequences of Values . . . . . . . . . . . . . . . . . . . . . . . . . . 38
2.7 Analysis of Software Components . . . . . . . . . . . . . . . . . . . . . . 40
2.7.1Control Flow Graphs . . . . . . . . . . . . . . . . . . . . . . . . . . 40
2.7.2Decisions and Conditions . . . . . . . . . . . . . . . . . . . . . . . 43
2.7.3Paths . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
2.7.4Data Flows . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
2.8 Analysis of Targets for Fault Insertion . . . . . . . . . . . . . . . . . . . . 47
2.8.1Offutt’s 5 Sufficient Mutations . . . . . . . . . . . . . . . . . . . . 47
2.9 TestArtefacts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
3 Unit Testing50
3.1 Techniques50
3.2 Usage51
3.3 Black-Box Techniques52
3.3.1 Equivalence Partitioning (EP)52
3.3.2 Boundary Value Analysis (BVA)53
3.3.3 Testing Combinations of Inputs55
3.3.4 Testing Sequences of Inputs/State-Based Testing56
3.3.5 Testing with Random Data . . . . . . . . . . . . . . . . . . . . . . 56
3.3.6 Error Guessing/Expert Opinion . . . . . . . . . . . . . . . . . . . . 58
3.4White-Box Techniques . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59
3.4.1Statement Coverage (SC) . . . . . . . . . . . . . . . . . . . . . . . 60
3.4.2 Branch Coverage (BC) . . . . . . . . . . . . . . . . . . . . . . . . . 61
3.4.3 Condition Coverage (CC) . . . . . . . . . . . . . . . . . . . . . . 62
3.4.4 Decision Condition Coverage (DCC) . . . . . . . . . . . . . . . . . 64
3.4.5 Multiple Condition Coverage (MCC) . . . . . . . . . . . . . . . . .65
3.4.6 Modified Condition Decision Coverage (MCDC) . . . . . . . . . .66
3.4.7 Path Coverage . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
3.4.8 Dataflow Coverage (DU Pairs) . . . . . . . . . . . . . . . . . . . . 68
3.5 Fault Insertion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
3.5.1 Strong Mutation Testing . . . . . . . . . . . . . . . . . . . . . . . . 69
3.6Test Ranking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
4 Unit Testing Examples 71
4.1Example One: fits() . .

Preface

This book is based on a series of lectures given at Maynooth University and Zhejiang University. It provides a textbook for a number of courses, describing the fundamentals of software testing. The material has been developed over the past ten years, and reflects both the experience of 20 years in industry from one of the authors, and the authors’ joint experience in lecturing.
There is no one standard textbook on software testing, and this book is the result of many years of extracting and interpreting test techniques from a wide and varied number of sources. These include testing classics such as The Art of Software Testing by Myers, Software Testing by Roper, Testing Object- Oriented Systems by Binder, and Introduction to Software Testing by Ammann and Offutt; standard software engineering textbooks such as Software Engineering by Pressman , and Software Engineering by Sommerville; software process books such as Software Testing in the Real World by Kit and extreme Programming explained by Beck; and ISO and IEEE standards related to software quality and testing.
Software testing is a challenging task–it is as important for businesses and government as it is for research institutions. It is still as much an art as a science: there are no accepted standards or norms for applying the various techniques, and interpretation is required. There is no well established research on the effectiveness of the different approaches. The techniques are easy to understand, but generally difficult to apply to real-world software. By providing extensive worked examples, this book aims to provide a solid basis for both understanding, and applying, various test techniques
In the second edition, many of the examples have been updated, and the sections on Integration Testing and System Testing have been expanded. The examples have been updated to work with the latest version of the tools used, and a companion website is provided (www.softwaretestingbook.org).
The software tools used in this book are merely representative–they have not been selected as the best example of each, but rather as good examples of the range of capabilities that such tools exhibit. The key goal of the book is that the reader should understand the principles of software testing, and be able to apply them in practice. The book does not endorse or recommend any particular tool. Only a subset of the tool features are covered in this book: the reader should refer to the tool-specific documentation for more details.



前　　言
本书的内容基于爱尔兰国立大学梅努斯分校和浙江大学的一系列课程讲稿。该书覆盖了软件测试的基本原理，可以作为许多课程的参考教材。本书的内容历经十年发展，既反映了其一位作者二十年的工业界经验，也融合了多位作者在教学方面的共同经验。
在软件测试领域，目前还没有统一的标准教科书，而本书是通过对各种不同的软件测试技术进行多年的提炼、阐释而形成。这些测试技术的来源包括一些经典的测试书籍如Myers的《软件测试的艺术》、Roper的《软件测试》、Binder的《面向对象系统测试》、Ammann和Offutt的《软件测试基础》；标准的软件工程教材如Pressman的《软件工程：实践者的研究方法》、Sommerville的《软件工程》；软件过程类书籍如Kit的《现实世界中的软件测试》、Beck的《极限编程》以及软件质量及测试相关的ISO和IEEE标准。
软件测试是一项具有挑战性的任务，它对科研机构、企业及政府具有同等的重要性。软件测试既是门科学也是门艺术。针对如何应用不同的软件测试技术，目前还没有广泛认同的标准，因此对各种软件测试技术的阐释是必须的。针对各种不同技术的有效性，目前还没有成熟的研究成果。总的来说，各种测试技术容易理解，但如何将其应用到软件产品中是困难的。本书旨在通过广泛丰富的实例，为读者对理解和如何应用各种不同的软件测试技术提供一个坚实的基础。
第2版对第1版的内容进行了全面更新和修订，新增和扩充了集成测试和系统测试两章。示例已更新，以使用新版本的工具，并提供了一个配套网站（www.soft-wareetestingbook.org）。
本书中使用的软件工具仅仅是这些工具中的代表—我们选择这些工具并不是因为它们是最佳工具，而是这些工具能够较好地展示我们想要说明的功能。本书的主要目标是让读者了解软件测试的原理，并能在实践中应用。本书不支持或推荐任何特定的工具。书中只介绍了工具的一部分特性：读者应该参考特定工具的详细文档。