ON VALIDATING REGRESSION MODELS WITH BOOTSTRAPS AND DATA SPLITTING TECHNIQUES
Validation, bootstrap, Data splitting techniques, coefficient of determination, and stepwise regression
Abstract
Model validity is the stability and reasonableness of the regression coefficients, the plausibility and usability of the regression function and ability to generalize inference drawn from the regression analysis. Model validation is an important step in the modeling process and helps in assessing the reliability of models before they can be used in decision making. This research work therefore seeks to study regression model validation process by bootstrapping approach and data splitting techniques. We review regression model validation by comparing predictive index accuracy of data splitting techniques and residual resampling bootstraps. Various validation statistic such as the mean square error (MSE), Mallow's cp and R2 were used as criteria for selecting the best model and the best selection procedure for each data set. The study shows that bootstrap provides the most precise estimate of R2 which reduce the risk over fitted models than in data splitting techniques..
Downloads
How to Cite
References
R Cheng (2004) Resampling methods. 16.
A Davison, D Hinkley (1997) Bootstrap Methods and their Application.
D Deflandre, J Kleijnen (2003) Statistical analysis of random simulations: Bootstrap tutorial. (38/39), 29-34.
Bradley Efron, Gail Gong (1983) A Leisurely Look at the Bootstrap, the Jackknife, and Cross-Validation. 37(1), 36-48.
B Efron, R Tibshirani (1993) Introduction to the Bootstrap.
Bradley Efron (1983) Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation. 78(382), 316-331.
C.-X Feng, Z Yu, A Kusiak (2004) Selection and validation of predictive regression and neural networks modeling data from designed experiment.
L Friedman, H Friedman (1995) Analyzing simulation output using the bootstrap method. 64(2), 95-100.
N Gershenfeld (1999) The Nature of Mathematical modeling.
P Hall, S Wilson (1991) Two guidelines for bootstrap hypothesis testing. 20, 231-246.
J Kleijnen, R Cheng, B Bettonvil (2001) Validation of trace-driven simulation models: Bootstrapped tests. 47(11), 1533-1538.
J Lazante (1984) Strategies for assessing skill and significance of screening regression models with emphasis on Monte Carlo techniques. 23, 1454-1458.
C Mallows (1995) C P and prediction with many regressors: comments on Mallows. 39(1), 115-116.
C Neuman, M Lawrence, E, Caso (1977) Monte Carlo significance testing as applied to statistical tropical cyclone prediction models. 16, 1165-1174.
T Olatayo (2010) On Truncated Geometric Bootstrapping Method for Stochastic Time Series Process.
A Oredein (2011) On Validating regression procedures with bootstraps and data splitting techniques.
Alvin Rencher, Fu Pun (1980) Inflation of R 2 in Best Subset Regression. 22(1), 49-53.
L Shapiro (1984) Sampling errors in statistical models of tropical cyclone motion: A comparison of predictor screening and EOF techniques. 112, 1378-1388.
Ronald Snee (1977) Validation of Regression Models: Methods and Examples. 19(4), 415-428.
Thomas Willemain, Robert Bress, Laura Halleck (2003) Enhanced Simulation Inference Using Bootstraps of Historical Inputs. 35(9), 851-862.
Published
2011-09-07
Issue
Section
License
Copyright (c) 2011 Authors and Global Journals Private Limited
This work is licensed under a Creative Commons Attribution 4.0 International License.