Define Expertise - II

Dana changed the operational definition of "novice" and "expert" for that usability test to include knowledge of using a web browser and evidence of the person doing a range of complex tasks on the web. This matrix of expertise (shown in Figure 7-1J also avoided the possible mismatch of expectations when participants are asked to rate their own expertise.

Jt's more accurate to use criteria that are measurable, objective "facts"  rather than subjective self-classifications on the part of potential end users. A seif-cJassification has the end user rate his or her own abilities and skill level, which is more subject to misinterpretation and wide variance.

For example, when attempting to classify a group of end users as "novice," before using them in a usability test, do not simply accept their own rating of themselves as "novice," "expert," and so on. Instead, find out by using a method something like the matrix in Figure 7-1. Although it still relies on participants reporting what they remember doing, at least it does gather more objective data about what they have done. This latter method has the advantage of using criteria on which everyone can readily agree. The team can determine a "score" for how each combination of tasks and frequencies defines different levels of expertise. For example, someone who marked all the tasks in the "Every week" row would likely be an expert user of the 

Internet. Likewise, someone who marked all of the tasks in the "Never" row probably would not qualify for most usability tests of web sites (depending on the objectives and research questions). People marking boxes between those extremes then become defined as "novice" or "intermediate/' again,