Application of Latent Roots Regression to Multicollinear Data
DOI:
https://doi.org/10.53555/nncse.v4i12.393Keywords:
Regression, Multicollinearity, Latent Root, Eigen values, Least Squares, Ridge Regression, Principal Component RegressionAbstract
Several applications are based on the assessment of a linear model including a variable y to Predictors x1, x2,..,xp. It often occurs that the predictors are collinear which results in a high instability of the model obtained by means of multiple linear regression using least squares estimation. Several alternative methods have been proposed in order to tackle this problem. Among these methods Ridge Regression, Principal Component Regression .We discuss a third method called Latent Root Regression. This method depends on the Eigen values and Eigen vectors of the matrix A'A ,where A is the matrix of y and x1, x2,..,xp . We introduce some properties of latent root regression which give new insight into the determination of a prediction model. Thus, a model may be determined by combining latent root estimators in such a way that the associated mean squared error is minimized .The method is illustrated using three real data sets. Namely: Economical , Medical and Environmental data . According to applications, our new estimators depending on the Latent Root Regression have better performances in the sense of MSE in most of the situations.
References
Bastlevsky, Alexander, (1994), “Statistical Factor Analysis and Related Methods”, John Wilay& Sons, INC.
Belsley, D. A., Kuh, E. and Welsch, R. E., (1980), “Regression Diagnostics Identifying Influential Data and Sources of Collinearity”, Wiley, New York.
Dounald F.M., (1978), “Multivariate statistical Methods”, 2nd Ed., McGraw-Hill Book Company, Tokyo.
Chatterjee, Samprit and Price, Bertram , (2000), “Regression Analysis by Example”, 3rd edition, John Wiley and Sons.
Draper N.R., and Smith H., (1981), “Applied Regression Analysis”, 2n Ed. John Wiley and Sons, Canada.
Fisher J.C., and Mason R.L., (1981), “The Analysis of Multicollinear Data in Criminology”, John Wiley and Sons.
Gunst R.F., and Mason R.L., (1980), “Regression Analysis and It's Application”, Marcel Dekker, New York, U.S.A.
Hawkins, D. M., (1973), “On the Investigation of Alternative Regression by Principal Component Analysis”, Applied Statistics, Vol. 22, No. 3, pp. 275-286.
Kutner, Michael H.; Nachtsheim, Christopher J. and Neter, John; Li, William, (2005),“Applied Linear Statistical Models”, 5th edition, McGraw- Hill Irwin, New York, USA.
Mason R.L., (1986), “Latent Root Regression: A Biased Regression Methodology for Use with Collinear Predictor Variables”,Commun. Statist. theor. Math., Vol.15 No. 9, pp. 2651-2678.
Pasha, G. R and Ali Shah, Muhammad Akbar, (2004), “Application of Ridge Regression to Multicollinear Data”, Journal of Research (Science), Bahauddin Zakariya University, Multan, Pakistan, Vol. 15, No. 1, pp. 97-106.
Al-Saffar, Azhar S. A., (2016), “Diagnosis and treatment of Outlier values in the models Linear with the application”,Master Thesis, University of Mosul, Iraq.
Yan, Xin and Gang Su, Xiao, (2009), “Linear Regression Analysis: Theory and Computing”, World Scientific Publishing, USA.
Downloads
Published
Issue
Section
License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
You are free to:
- Share — copy and redistribute the material in any medium or format for any purpose, even commercially.
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
- The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms:
- Attribution — You must give appropriate credit , provide a link to the license, and indicate if changes were made . You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices:
You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation .
No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.