Decomposition of the Random Error Vector of a General Linear Model
coefficient matrix; decomposition; least squares; orthogonal complement; projection; vector space
Abstract
This paper deals with the decomposition of an error vector to identify how the error vector is related to the expected value of an observation vector under a general linear sample model since the error vector is defined as the deviance of observation vector from the expected value. The main idea of the paper is in that a random error vector can be decomposed into two orthogonal components vectors; i.e., one is in a vector space generated by the coefficient matrix of the unknown parameter vector and the other is in orthogonal complement of it. As related topics to the decomposition, two things are discussed: partitioning an observation vector and constructing the covariance structure of it. It also shows the reason why a projection method would be preferred rather than a least squares method.
Downloads
How to Cite
References
S Searle (1971) Linear models.
F Graybill (1976) Theory and Application of the Linear Model.
N Draper, H Smith (1981) Applied Regression Analysis.
F Graybill (1983) Matrices with Applications in Statistics.
D Johnson, R Wichern (2014) Applied multivariate statistical analysis.
George Milliken, Dallas Johnson (1984) Analysis of Messy Data Volume 1.
Bruce Hill (1965) Inference about Variance Components in the One-Way Model. 60(311), 806-825.
S Searle, G Casella, C Mcculloch (2009) Variance components.
J Choi (2019) Nonnegative estimates of variance components in a two-way random model. 127, 1-10.
Jaesung Choi (2020) Nonnegative variance component estimation for mixed-effects models. 27(5), 523-533.
Jaesung Choi (1210) Nonnegative Estimation of Variance Components for a Nested Three-Way Random Model. 14(6), 1210.
W Krumbein, F Graybill (1965) An introduction to statistical models in geology.
W Thompson (1961) Negative estimates of variance components: an introduction. 34, 1-4.
W Thompson (1962) The Problem of Negative Estimates of Variance Components. 33(1), 273-289.
W Thompson, James Moore (1963) Non-Negative Estimates of Variance Components. 5(4), 441-449.
J Nelder (1954) The interpretation of negative components of variance. 41(3-4), 544-548.
C Henderson (1953) Estimation of Variance and Covariance Components. 9(2), 226.
H Hartley (1967) Expectations, variances and covariances of ANOVA means squares by "synthesis. 23, 105-114.
F Satterthwaite (1946) An Approximate Distribution of Estimates of Variance Components. 2(6), 110.
Published
2023-04-13
Issue
Section
License
Copyright (c) 2023 Authors and Global Journals Private Limited

This work is licensed under a Creative Commons Attribution 4.0 International License.