CS 552, Spring 1998

General Guidelines Based on Studying Programmer Behavior Experimentally

Adapted from Ruven E. Brooks, 1980, "Studying Programmer Behavior Experimentally: The Problems of Proper Methodology" Communications of the ACM, April 1980, pp. 207-213.

(1) Subjects of a programming test should be both representative and uniform.

(2) Do not use students of programming courses as accurate representatives of advanced programmers.

(3) Use within-subject testing when testing programming behavior.

(4) Exclude irrelevant behavior when measuring time.