Advanced Statistics - Biology 603

Bowling Green State University, Spring 2008

Worksheet - Variance-Covariance Matrix and Correlation Matrix

Raw data (i.e., Raw score matrix)

Variable

Individuals

Σ

x1

1

2

1

5

4

13

x2

2

3

2

4

4

15

x3

3

4

3

5

4

17

Calculate the mean vector

Σ
 Mean
x1

13

2.6

x2

15

3.0

x3

17

3.4

Obtain a listing of deviations from the mean vector (i.e., Deviation matrix)

 
Individuals

Deviations from Variable Means

x1
-1.6
x2
x3

Matrix multiplication - this procedure calculates the crossproduct of the original matrix of differences (A) with a transposed copy (A') of itself (i.e., one in which rows and columns have been inverted). This results in a new matrix with dimensions of 3 (i.e., rows of A) x 3 (i.e., (columns of A')

-1.6

-0.6

-1.6

2.4

1.4

-1

0

-1

1

1

-0.4

0.6

-0.4

-0.4

0.6

*
-1.6 -1 -0.4
-0.6 0 0.6
-1.6 -1 -0.4
2.4 1 -0.4
1.4 1 0.6
=

Σ (-1.62 + -.62 + -1.62 + 2.42 + 1.42)

Σ (-12 + 02 + -12 + 12 + 12)

Σ (-.42 + .62 + .42 + -.42 + .62)

Deviation SSCP (Sums of Squares and Cross Products) matrix. This procedure calculates the sums of squares along the diagonal and the sums of Cross product in the lower triangle off the diagonal. All products are calculated as length vector 1 * length of vector 2 * sine of angle between vector 1 and 2. As the different variables are orthogonal to each other (i.e., the angle between them is 90o), the angle term of the product formula therefore is always 1 (i.e., sine(90o) = 1) and can thus be dropped from these calculations. Note there are three different, mathematically equivalent techniques to calculate the deviation SSCP. The symbol X in all tables below refers to the differences from the mean and not the raw variable measures.

 

Symbols

Example Numbers

  1 2 3 1 2 3
1 Σ X12

13.2

2 Σ X1X2 Σ X22    
3 Σ X1X3 Σ X2X3 Σ X32      

Variance-Covariance Matrix. This procedure calculates the variance (i.e., MS) for each variable along the diagonal and the covariances the lower triangle off the diagonal. Recall that variance estimates refer to a sum of squares divided by its degrees of freedom

 

Symbols

Example Numbers

  1 2 3 1 2 3
1 σ21=Σ X12/(N-1)

3.3

2 Σ X1X2/(N-1) σ22=Σ X22/(N-1)    
3 Σ X1X3/(N-1) Σ X2X3/(N-1) σ23=Σ X32/(N-1)      

Standard Deviation Matrix. This procedure calculates the standard deviations (s) as the quare root of the variances along the diagonal and the covariances in the lower triangle off the diagonal.

 

Symbols

Example Numbers

  1 2 3 1 2 3
1 σ1=
SQRT(Σ X12/(N-1))

1.8166
2 σ1,2=
SQRT(Σ X1X2/(N-1))
σ2=
SQRT(Σ X22/(N-1))
   
3 σ1,3=
SQRT(Σ X1X3/(N-1))
σ2,3=
SQRT(Σ X2X3/(N-1))
σ3=
SQRT(Σ X32/(N-1))
     

Correlation matrix. i.e., Standardized variance/covariance matrix - Divide each entry by two standard deviations (s), one for each relevant row and column. Understand why this is identical to the Variance/covariance matrix calculated from the deviation matrix in which deviations have been standardized (i.e. replaced with their standard normal deviates). Terms in the variance/covariance matrix are standardized to a s2 of 1 by dividing all variance terms by its variance and all covariance terms by its covariance.

 

Symbols

Example Numbers

  1 2 3 1 2 3
1 Σ X12/((N-1)σ1σ1)

1

2 Σ X1X2/((N-1)σ1σ2) Σ X22/((N-1)σ2σ2)    
3 Σ X1X3/((N-1)σ1σ3) Σ X2X3/((N-1)σ2σ3) Σ X32/((N-1)σ3σ3)      

Matrix of Coefficients of Determination (r2) - Note: Do not use in Correlation analysis. Square each entry from above.

 

Symbols

Example Numbers

  1 2 3 1 2 3
1 (Σ X12/((N-1)σ1σ1))2

1
2 (Σ > X1X2/((N-1)σ1σ2))2 (Σ X22/((N-1)σ2σ2))2    
3 (Σ > X1X3/((N-1)σ1σ3))2 (Σ > X2X3/((N-1)σ2σ3))2 (Σ X32/((N-1)σ3σ3))2      

If you have difficulties in performing these steps, review some of the basic concepts in matrix algebra.


last modified: 2/7/05
This material is copyrighted and MAY NOT be used for commercial purposes, © 2001-2008 lobsterman.
[ Advanced Statistics Course page | About BIO 603 | Announcements ]
[ Course syllabus | Exams & Grading | Glossary | Evaluations | Links ]