Covariance Structures
This section provides additional information on covariance structures.
Ante-Dependence: First-Order. This covariance structure has heterogenous variances and heterogenous correlations between adjacent elements. The correlation between two nonadjacent elements is the product of the correlations between the elements that lie between the elements of interest.
(σ1 2 | σ2σ1ρ1 | σ3σ1ρ1ρ2 | σ4σ1ρ1ρ2ρ3) |
(σ2σ1ρ1 | σ2 2 | σ3σ2ρ2 | σ4σ2ρ2ρ3) |
(σ3σ1ρ1ρ2 | σ3σ2ρ2 | σ3 2 | σ4σ3ρ3) |
(σ4σ1ρ1ρ2ρ3 | σ4σ2ρ2ρ3 | σ4σ3ρ3 | σ4 2) |
AR(1). This is a first-order autoregressive structure with homogenous variances. The correlation between any two elements is equal to rho for adjacent elements, rho2 for elements that are separated by a third, and so on. is constrained so that –1<<1.
(σ2 | σ2ρ | σ2ρ2 | σ2ρ3) |
(σ2ρ | σ2 | σ2ρ | σ2ρ2) |
(σ2ρ2 | σ2ρ | σ2 | σ2ρ) |
(σ2ρ3 | σ2ρ2 | σ2ρ | σ2) |
AR(1): Heterogenous. This is a first-order autoregressive structure with heterogenous variances. The correlation between any two elements is equal to r for adjacent elements, r2 for two elements separated by a third, and so on. is constrained to lie between –1 and 1.
(σ1 2 | σ2σ1ρ | σ3σ1ρ2 | σ4σ1ρ3) |
(σ2σ1ρ | σ2 2 | σ3σ2ρ | σ4σ2ρ2) |
(σ3σ1ρ2 | σ3σ2ρ | σ3 2 | σ4σ3ρ) |
(σ4σ1ρ3 | σ4σ2ρ2 | σ4σ3ρ | σ4 2) |
ARMA(1,1). This is a first-order autoregressive moving average structure. It has homogenous variances. The correlation between two elements is equal to * for adjacent elements, *(2) for elements separated by a third, and so on. and are the autoregressive and moving average parameters, respectively, and their values are constrained to lie between –1 and 1, inclusive.
(σ2 | σ2φρ | σ2φρ2 | σ2φρ3) |
(σ2φρ | σ2 | σ2φρ | σ2φρ2) |
(σ2φρ2 | σ2φρ | σ2 | σ2φρ) |
(σ2φρ3 | σ2φρ2 | σ2φρ | σ2) |
Compound Symmetry. This structure has constant variance and constant covariance.
(σ2 + σ1 2 | σ1 | σ1 | σ1) |
(σ1 | σ2 + σ1 2 | σ1 | σ1) |
(σ1 | σ1 | σ2 + σ1 2 | σ1) |
(σ1 | σ1 | σ1 | σ2 + σ1 2) |
Compound Symmetry: Correlation Metric. This covariance structure has homogenous variances and homogenous correlations between elements.
(σ2 | σ2ρ | σ2ρ | σ2ρ) |
(σ2ρ | σ2 | σ2ρ | σ2ρ) |
(σ2ρ | σ2ρ | σ2 | σ2ρ) |
(σ2ρ | σ2ρ | σ2ρ | σ2) |
Compound Symmetry: Heterogenous. This covariance structure has heterogenous variances and constant correlation between elements.
(σ1 2 | σ2σ1ρ | σ3σ1ρ | σ4σ1ρ) |
(σ2σ1ρ | σ2 2 | σ3σ2ρ | σ4σ2ρ) |
(σ3σ1ρ | σ3σ2ρ | σ3 2 | σ4σ3ρ) |
(σ4σ1ρ | σ4σ2ρ | σ4σ3ρ | σ4 2) |
Diagonal. This covariance structure has heterogenous variances and zero correlation between elements.
(σ1 2 | 0 | 0 | 0) |
(0 | σ2 2 | 0 | 0) |
(0 | 0 | σ3 2 | 0) |
(0 | 0 | 0 | σ4 2) |
Direct product AR1 (UN_AR1). Specifies the Kronecker product of one unstructured matrix and the other first-order auto-regression covariance matrix. The first unstructured matrix models the multivariate observation, and the second first-order auto-regression covariance structure models the data covariance across time or another factor.
Direct product unstructured (UN_UN). Specifies the Kronecker product of two unstructured matrices, with the first one modeling the multivariate observation, and second one modeling the data covariance across time or another factor.
Direct product compound symmetry (UN_CS). Specifies the Kronecker product of one unstructured matrix and the other compound-symmetry covariance matrix with constant variance and covariance. The first unstructured matrix models the multivariate observation, and the second compound symmetry covariance structure models the data covariance across time or another factor.
Factor Analytic: First-Order. This covariance structure has heterogenous variances that are composed of a term that is heterogenous across elements and a term that is homogenous across elements. The covariance between any two elements is the square root of the product of their heterogenous variance terms.
(λ1 2 + d | λ2λ1 | λ3λ1 | λ4λ1) |
(λ2λ1 | λ2 2 + d | λ3λ2 | λ4λ2) |
(λ3λ1 | λ3λ2 | λ3 2 + d | λ4λ3) |
(λ4λ1 | λ4λ2 | λ4λ3 | λ4 2 + d) |
Factor Analytic: First-Order, Heterogenous. This covariance structure has heterogenous variances that are composed of two terms that are heterogenous across elements. The covariance between any two elements is the square root of the product of the first of their heterogenous variance terms.
(λ1 2 + d1 | λ2λ1 | λ3λ1 | λ4λ1) |
(λ2λ1 | λ2 2 + d2 | λ3λ2 | λ4λ2) |
(λ3λ1 | λ3λ2 | λ3 2 + d3 | λ4λ3) |
(λ4λ1 | λ4λ2 | λ4λ3 | λ4 2 + d4) |
Huynh-Feldt. This is a "circular" matrix in which the covariance between any two elements is equal to the average of their variances minus a constant. Neither the variances nor the covariances are constant.
(σ1 2 | [σ1 2 + σ2 2]/2 - λ | [σ1 2 + σ3 2]/2 - λ | [σ1 2 + σ4 2]/2 - λ) |
([σ1 2 + σ2 2]/2 - λ | σ2 2 | [σ2 2 + σ3 2]/2 - λ | [σ2 2 + σ4 2]/2 - λ) |
([σ1 2 + σ3 2]/2 - λ | [σ2 2 + σ3 2]/2 - λ | σ3 2 | [σ3 2 + σ4 2]/2 - λ) |
([σ1 2 + σ4 2]/2 - λ | [σ2 2 + σ4 2]/2 - λ | [σ3 2 + σ4 2]/2 - λ | σ4 2) |
Scaled Identity. This structure has constant variance. There is assumed to be no correlation between any elements.
(σ2 | 0 | 0 | 0) |
(0 | σ2 | 0 | 0) |
(0 | 0 | σ2 | 0) |
(0 | 0 | 0 | σ2) |
Spatial: Power. This covariance structure has homogenous variances and heterogenous correlations between elements. dij is the estimated Euclidean distance between the ith and jth measurement.
(σ2 | σ2 ρd12 | σ2 ρd13 | σ2 ρd14 ) |
(σ2 ρd12 | σ2 | σ2 ρd23 | σ2 ρd24 ) |
(σ2 ρd13 | σ2 ρd23 | σ2 | σ2 ρd34 ) |
(σ2 ρd14 | σ2 ρd24 | σ2 ρd34 | σ2 ) |
Spatial: Exponential. This covariance structure has homogenous variances and heterogenous correlations between elements. dij is the estimated Euclidean distance between the ith and jth measurement.
(σ2 | σ2 exp{-d12/θ} | σ2exp{-d13/θ} | σ2exp{-d14/θ} ) |
(σ2 exp{-d12/θ} | σ2 | σ2exp{-d23/θ} | σ2 exp{-d24/θ} ) |
(σ2exp{-d13/θ} | σ2 exp{-d23/θ} | σ2 | σ2 exp{-d34/θ} ) |
(σ2exp{-d14/θ} | σ2 exp{-d24/θ} | σ2 exp{-d34/θ} | σ2 ) |
Spatial: Gaussian. This covariance structure has homogenous variances and heterogenous correlations between elements. dij is the estimated Euclidean distance between the ith and jth measurement.
(σ2 | σ2 exp{-d12/ρ2} | σ2exp{-d13/ρ2} | σ2exp{-d14/ρ2} ) |
(σ2 exp{-d12/ρ2} | σ2 | σ2exp{-d23/ρ2} | σ2 exp{-d24/ρ2} ) |
(σ2exp{-d13/ ρ2} | σ2 exp{-d23/ρ2} | σ2 | σ2 exp{-d34/ρ2} ) |
(σ2exp{-d14/ρ2} | σ2 exp{-d24/ρ2} | σ2 exp{-d34/ρ2} | σ2 ) |
Spatial: Linear. This covariance structure has homogenous variances and heterogenous correlations between elements. dij is the estimated Euclidean distance between the ith and jth measurement, and 1ij is an indicator function which is 1 if ρdij ≤ 0 and 0 otherwise.
(σ2 | σ2(1 - ρd12) 112 | σ2(1 - ρd13) 113 | σ2(1 - ρd14) 114 ) |
(σ2(1 - ρd12) 112 | σ2 | σ2(1 - ρd23) 123 | σ2(1 - ρd24) 124 ) |
(σ2(1 - ρd13) 113 | σ2(1 - ρd23) 123 | σ2 | σ2(1 - ρd34) 134 ) |
(σ2(1 - ρd14) 114 | σ2(1 - ρd24) 124 | σ2(1 - ρd34) 134 | σ2 ) |
Spatial: Linear-log. This covariance structure has homogenous variances and heterogenous correlations between elements. dij is the estimated Euclidean distance between the ith and jth measurement, and 1ij is an indicator function which is 1 if ρ log(dij) ≤ 0 and 0 otherwise.
(σ2 | σ2(1 - ρ log(d12)) 112 | σ2(1 - ρ log(d13)) 113 | σ2(1 - ρ log(d14)) 114 ) |
(σ2(1 - ρ log(d12)) 112 | σ2 | σ2(1 - ρ log(d23)) 123 | σ2(1 - ρ log(d24)) 124 ) |
(σ2(1 - ρ log(d13)) 113 | σ2(1 - ρ log(d23)) 123 | σ2 | σ2(1 - ρ log(d34)) 134 ) |
(σ2(1 - ρ log(d14)) 114 | σ2(1 - ρ log(d24)) 124 | σ2(1 - ρ log(d34)) 134 | σ2 ) |
Spatial: Spherical. This covariance structure has homogenous variances and heterogenous correlations between elements. rij = dij/ρ, where dij is the estimated Euclidean distance between the ith and jth measurement. 1ij is an indicator function which is 1 if dij ≤ ρ and 0 otherwise.
(σ2 | σ2(1 - 3/2r12 + 1/2r312) 112 | σ2(1 - 3/2r13 + 1/2r313) 113 | σ2(1 - 3/2r14 + 1/2r314) 114 ) |
(σ2(1 - 3/2r12 + 1/2r312) 112 | σ2 | σ2(1 - 3/2r23 + 1/2r323) 123 | σ2(1 - 3/2r24 + 1/2r324) 124 ) |
(σ2(1 - 3/2r13 + 1/2r313) 113 | σ2(1 - 3/2r23 + 1/2r323) 123 | σ2 | σ2(1 - 3/2r34 + 1/2r334) 134 ) |
(σ2(1 - 3/2r14 + 1/2r314) 114 | σ2(1 - 3/2r24 + 1/2r324) 124 | σ2(1 - 3/2r34 + 1/2r334) 134 | σ2 ) |
Toeplitz. This covariance structure has homogenous variances and heterogenous correlations between elements. The correlation between adjacent elements is homogenous across pairs of adjacent elements. The correlation between elements separated by a third is again homogenous, and so on.
(σ2 | σ2ρ1 | σ2ρ2 | σ2ρ3) |
(σ2ρ1 | σ2 | σ2ρ1 | σ2ρ2) |
(σ2ρ2 | σ2ρ1 | σ2 | σ2ρ1) |
(σ2ρ3 | σ2ρ2 | σ2ρ1 | σ2) |
Toeplitz: Heterogenous. This covariance structure has heterogenous variances and heterogenous correlations between elements. The correlation between adjacent elements is homogenous across pairs of adjacent elements. The correlation between elements separated by a third is again homogenous, and so on.
(σ1 2 | σ2σ1ρ1 | σ3σ1ρ2 | σ4σ1ρ3) |
(σ2σ1ρ1 | σ2 2 | σ3σ2ρ1 | σ4σ2ρ2) |
(σ3σ1ρ2 | σ3σ2ρ1 | σ3 2 | σ4σ3ρ1) |
(σ4σ1ρ3 | σ4σ2ρ2 | σ4σ3ρ1 | σ4 2) |
Unstructured. This is a completely general covariance matrix.
(σ1 2 | σ2 1 | σ31 | σ41) |
(σ2 1 | σ2 2 | σ32 | σ4 2) |
(σ31 | σ32 | σ3 2 | σ4 3) |
(σ41 | σ4 2 | σ4 3 | σ4 2) |
Unstructured: Correlation Metric. This covariance structure has heterogenous variances and heterogenous correlations.
(σ1 2 | σ2σ1ρ21 | σ3σ1ρ31 | σ4σ1ρ41) |
(σ2σ1ρ21 | σ2 2 | σ3σ2ρ32 | σ4σ2ρ42) |
(σ3σ1ρ31 | σ3σ2ρ32 | σ3 2 | σ4σ3ρ43) |
(σ4σ1ρ41 | σ4σ2ρ42 | σ4σ3ρ43 | σ4 2) |
Variance Components. This structure assigns a scaled identity (ID) structure to each of the specified random effects.