CS 552, Spring 1998

General Guidelines Based on Studying Programmer Behavior Experimentally

Adapted from Ruven E. Brooks, 1980, "Studying Programmer Behavior Experimentally: The Problems of Proper Methodology" Communications of the ACM, April 1980, pp. 207-213.


(1) Subjects of a programming test should be both representative and uniform.


(2) Do not use students of programming courses as accurate representatives of advanced programmers.


(3) Use within-subject testing when testing programming behavior.


(4) Exclude irrelevant behavior when measuring time.