CS252. User Interface Design

Lecture Outline for Feb. 28
Choosing an Evaluation Method


1. 	Overview
     To select an appropriate method, must consider







     Based on those answers, will reduce the number of choices to one or very few



2.   Why the Evaluation Is Needed
     (1) What is the goal of the evaluation?







     Formative evaluations
 

     Summative evaluations



     (2) What material is available for being evaluated?









3.   What Information Is Sought
     (1) What do you want to know, and why?








     (2) What type of data do you need?
          (1) Quantitative vs. qualitative measures
          (2) Performance vs. attitude data
          Examples of data obtain using empirical methods
               Performance data
               (Quant.) 


               (Qual.) 


               Attitude data
               (Quant.) 


               (Qual.) 


          Examples of data obtained using non-empirical methods
               Performance data
               (Quant.) 


               (Qual.) 


               Attitude data
               (Quant.) 


               (Qual.) 



4.   Availability of Participants
     (1) How many evaluators will participate?  How much expertise do they have?





     (2) Are subjects available?  How can they be characterized?





5.   Other Constraints
     (1)What kind of environment is there for testing?




     (2) How soon do the results need to be known?


     (3) How much money is available