【正文】 is important to categorize the kinds of system tests for a number of reasons: ? Systematically focus on different aspects of a system while evaluating its quality. ? Test engineers can prioritize their activities. ? Planning based on test categorization has the advantage of obtaining a balanced view of testing. ? Testing categories (11 categories) 與課程有關(guān)的問(wèn)題 2022machunyan 西北工業(yè)大學(xué)軟件與微電子學(xué)院 Basic System Tests ? These provide evidence that the system can be installed, configured and brought to an operational state. ? Basic tests are performed to ensure that monly used functions, not all of which may directly relate to userlevel functions, work to our satisfaction. ? The following are the major categories of subsystems whose adequate testing is called basic test. a. Boot tests: verify that the system can boot up its software image from the supported options (ROM, PCMCIA, ...) b. Upgrade/downgrade tests: verify that the software image can be upgraded or downgraded (rolled back) in a graceful manner. c. Light emitting diode (LED) tests. These are designed to ensure that that visual operational status of the system is correct. d Diagnostic tests. These are designed to ensure that the hardware ponents of the systems are functioning as desired. (Poweron self test (POST), Memory, Address and data buses, Peripheral devices) e) CLI (mand line interface) tests. Ensure that the system can be configured. Ensure that uses mands are properly interpreted. Verify the error message 與課程有關(guān)的問(wèn)題 2022machunyan 西北工業(yè)大學(xué)軟件與微電子學(xué)院 Functionality Tests ? Verify the system as thoroughly as possible over the full range of requirements ? Logging and tracing tests: (implicit functionality) ? GUI tests: (Icon, Menu bar, Dialog box, Scroll bar) ? Security tests. Verify that the system meets the requirements for detecting security breaches and protecting from such breaches (Unauthorized access, Illegal file access, Virus) 與課程有關(guān)的問(wèn)題 2022machunyan 西北工業(yè)大學(xué)軟件與微電子學(xué)院 Robustness Tests ? To verify how gracefully the system behaves in error situations, or how it handles a change in its operational environment. ? Different kinds of tests are: ? Boundary value tests (valid and invalid inputs) ? Recover from power failure ? Online insertion and removal (OIR) ? System recovers after an OIR event ? Availability of redundant modules ? Degraded node test (a portion of the system fails) 與課程有關(guān)的問(wèn)題 2022machunyan 西北工業(yè)大學(xué)軟件與微電子學(xué)院 Interoperability and Performance Tests ? Interoperability tests (3rd party products): Verify that the system can inter operate with 3rd party products. ? Performance tests: Determine how actual system performance pares to predicted performance ? Response time ? Execution time ? Throughput ? Resource utilization ? Traffic volume 與課程有關(guān)的問(wèn)題 2022machunyan 西北工業(yè)大學(xué)軟件與微電子學(xué)院 Scalability Tests ? Verify that the system can scale up to its engineering limits ? Data storage limitations (counters and buffers) ? Speed limitations (CPU) ? Communication limitations ? Resource intensive 與課程有關(guān)的問(wèn)題 2022machunyan 西北工業(yè)大學(xué)軟件與微電子學(xué)院 Stress Tests ? Stress tests (push it over the edge to break it). Evaluate the behavior of a software ponent when offered load is in excess of its designed capacity ? Push the system “over the edge” and observe that the recovery mechanism works ? Bring out the following kinds of problems: ? Memory leaks ? Buffer allocation problem 與課程有關(guān)的問(wèn)題 2022machunyan 西北工業(yè)大學(xué)軟件與微電子學(xué)院 Load and Regression Tests ? Load and stability tests: Verify that the system can operate in a large scale for a long time (months) ? Regression tests: Ensure that nothing had has happened after a fix. ? Five possibilities can happen after an attempt to fix. ? fix the bug reported ? fail to fix the bug ? fix the bug, but break something else ? fail to fix the bug, but break something else ? fix this bug and fix some unknown bugs 與課程有關(guān)的問(wèn)題 2022machunyan 西北工業(yè)大學(xué)軟件與微電子學(xué)院 Documentation Tests ? Documentation tests: This is a review of technical accuracy and readability of user manuals including ? tutorials ? online help ? There are three kinds of documentation tests ? Read test (clarity, anization, flow and accuracy) ? Handson test (evaluate usefulness) ? Functional test (verify the document) 與課程有關(guān)的問(wèn)題 2022machunyan 西北工業(yè)大學(xué)軟件與微電子學(xué)院 Conformance to Regulatory Bodies ? Conformance to regulatory bodies: ? Identify unsafe consequences ? Federal Communication Commission (FCC) and Canadian Standards ? Association (CSA) certify a product39。s safety.