Application of Latent Roots Regression to Multicollinear Data

Authors

  • Mowafaq Muhammed Al Kassab Department of Statistics & Informatics, College of Mathematics and Computer Sciences, University of Mosul, Mosul, Iraq
  • Dilnas Salah Adeen Younis Department of Statistics & Informatics, College of Mathematics and Computer Sciences, University of Mosul, Mosul, Iraq

DOI:

https://doi.org/10.53555/nncse.v4i12.393

Keywords:

Regression, Multicollinearity, Latent Root, Eigen values, Least Squares, Ridge Regression, Principal Component Regression

Abstract

 Several applications are based on the assessment of a linear model including a variable y to Predictors  x1, x2,..,xp. It often occurs that the predictors are collinear which results in a high instability of the model obtained by means of multiple linear regression using least squares estimation. Several alternative methods have been proposed in order to tackle this problem. Among these methods Ridge Regression, Principal Component  Regression .We discuss a third method called Latent  Root Regression. This method  depends on the Eigen values and Eigen vectors of the matrix A'A ,where A is the matrix of  y and x1, x2,..,xp . We introduce some properties of latent root regression which give new insight into the determination of a prediction model. Thus, a model may be determined by combining latent root estimators in such a way that the associated mean squared error is minimized .The method is illustrated using three real data sets. Namely: Economical , Medical and Environmental data . According to applications, our new estimators depending on the Latent Root Regression have better performances in the sense of MSE in most of the situations.         

References

Bastlevsky, Alexander, (1994), “Statistical Factor Analysis and Related Methods”, John Wilay& Sons, INC.

Belsley, D. A., Kuh, E. and Welsch, R. E., (1980), “Regression Diagnostics Identifying Influential Data and Sources of Collinearity”, Wiley, New York.

Dounald F.M., (1978), “Multivariate statistical Methods”, 2nd Ed., McGraw-Hill Book Company, Tokyo.

Chatterjee, Samprit and Price, Bertram , (2000), “Regression Analysis by Example”, 3rd edition, John Wiley and Sons.

Draper N.R., and Smith H., (1981), “Applied Regression Analysis”, 2n Ed. John Wiley and Sons, Canada.

Fisher J.C., and Mason R.L., (1981), “The Analysis of Multicollinear Data in Criminology”, John Wiley and Sons.

Gunst R.F., and Mason R.L., (1980), “Regression Analysis and It's Application”, Marcel Dekker, New York, U.S.A.

Hawkins, D. M., (1973), “On the Investigation of Alternative Regression by Principal Component Analysis”, Applied Statistics, Vol. 22, No. 3, pp. 275-286.

Kutner, Michael H.; Nachtsheim, Christopher J. and Neter, John; Li, William, (2005),“Applied Linear Statistical Models”, 5th edition, McGraw- Hill Irwin, New York, USA.

Mason R.L., (1986), “Latent Root Regression: A Biased Regression Methodology for Use with Collinear Predictor Variables”,Commun. Statist. theor. Math., Vol.15 No. 9, pp. 2651-2678.

Pasha, G. R and Ali Shah, Muhammad Akbar, (2004), “Application of Ridge Regression to Multicollinear Data”, Journal of Research (Science), Bahauddin Zakariya University, Multan, Pakistan, Vol. 15, No. 1, pp. 97-106.

Al-Saffar, Azhar S. A., (2016), “Diagnosis and treatment of Outlier values in the models Linear with the application”,Master Thesis, University of Mosul, Iraq.

Yan, Xin and Gang Su, Xiao, (2009), “Linear Regression Analysis: Theory and Computing”, World Scientific Publishing, USA.

Downloads

Published

2017-12-31

How to Cite

Al Kassab, M. M., & Adeen Younis, D. S. (2017). Application of Latent Roots Regression to Multicollinear Data. Journal of Advance Research in Computer Science & Engineering (ISSN 2456-3552), 4(12), 01-09. https://doi.org/10.53555/nncse.v4i12.393