Test 3: Verífication Test - II

Test Objectives

- Verify that 70 percent of participants can meet established successful completion criteria for each major task scenario. (The 70 percent benchmark is something that Jeff has personally evolved toward over time, and that Dana has used effectively. It provides a rea sonably challenging test while still leaving the design team some work to do before product release to move that number toward a more accept and trad»tional 95 percent benchmark. A benchmark of 100 percent is probably not realistic except for tasks iiwolving danger or damage to the system or possible loss of life, and should never be used lightly

In the 1960s NASA found that achieving 100 percent performance cost as much as 50 times the cost of achieving 95 percent performance, It is likely that such costs have gone down over 40 years, but the point is that you should only use the higher benchmark if you are willing to pay the piper.)

- Identify any tasks and areas oí the product that risk diré consequences (e.g., are unusable, contain destructive bugs) if the product is released as is.

- Identify all usability deficiencies and sources of those problems. Determine which deficiencies must be repatred befare release and which, if there is not time within the schedule, can be implemented in the next

release.