Part V: Analysis of Variance (ANOVA)
Randomized Blocks Designs (RBD)

 
 
The RBD or Treatments x Blocks design is another way to control for individual differences, thereby reducing error variance. The first step in doing this is to find some basis for the selection of subjects for our experiment. We identify those characteristics of subjects which are known to influence the behavior of interest and which may be measured before the start of the experiment. For example, in problem solving experiments, we may wish to control for intelligence (using IQ scores or GPA).

By identifying important sources of individual differences before the start of the experiment, we can select a homogeneous group of subjects to serve in the study. In doing so, we are reducing the within groups variance by restricting the variation due to a particular subject characteristic that would otherwise be unchecked in an SRD approach. The RBD includes groups of homogeneous subjects drawn from two or more ability levels. In addition, in the RBD, we can evaluate the presence of an interaction between the treatments and the subject characteristic that formed the basis for subject selection. If the Treatment x Blocks interaction is significant, then we will know that the effects of the treatments do not generalize across the abilities or classifications of subjects represented in the experiment. If the interaction is not significant, then we have achieved a certain degree of generalizability of the results.

The removal of this Treatments x Blocks interaction from the error term makes the error term smaller than the analogous error term in the SRD. The RBD error term also reflects the variability of subjects from populations in which variation in the blocking factor is greatly restricted. It should be noted that the degree to which blocking results in a reduction of the error term depends on the magnitude of the correlation between the scores forming the basis of the blocking and the scores on the DV. If the blocking factor is not highly correlated with the DV, we may actually lose power since we will have just as heterogeneous a population as in the SRD and we are needlessly giving up degrees of freedom to account for the blocking factor. Feldt (1958) says to use the unblocked design (SRD) when the correlation between the blocking factor and the DV is less than .2. But if the assessment of the Treatments by Blocks interaction is the primary purpose of the study, then a low correlation will not affect the decision to use RBD. Overall, the reduced error term makes the RBD more powerful than the SRD, but not quite as powerful as the RMD.

In the RBD, subjects are matched or blocked on a third variable that is related to the DV. Usually the 3rd variable, or blocking variable, is a state variable which subjects either have or do not have (i.e. anxiety, IQ, gender, SES). In the RBD, we have a groups that are fixed and b fixed levels of the blocking factor. Within each Treatment by Block cell there are n subjects. Thus, N = (a)(b)(n).

Example: Age may be a factor in problem solving ability so we block on age. T1 involved an anagram task, T2 involved word problems, and T3 involved numerical problem solving.

Age T1 T2 T3
20-30 1 5 9
  2 6 10
  3 7 11
  4 8 12
31-40 13 17 21
  14 18 22
  15 19 23
  16 20 24
41-50 25 29 33
  26 30 34
  27 31 35
  28 32 36

This test, then, runs using several assumptions:

  1. DV is interval and N.D.
  2. Homogeneity of variance.
  3. Blocking variable is related to the DV.
 
 
The ANOVA summary table for the RBD is as follows:

Source SS df MS F
(Between)   (a)(b) - 1    
  A (Fixed) SSA a - 1 SSA / dfA MSA / MSS/AB
  B (Fixed) SSB b - 1 SSB / dfB MSB / MSS/AB
  AxB (Fixed) SSAxB (a - 1)(b - 1) SSAxB / dfAxB MSAxB / MSS/AB
(Error)        
  S/AB SSS/AB (a)(b)(n - 1) SSS/AB / dfS/AB  
Total   (a)(b)(n) - 1    

An important note: The RBD is what is essentially called a factorial design. Indeed, the calculation and interpretation of each are virtually identical.