caa a22 4500 605477922 CHVBK 20210128100403.0 cr unu---uuuuu 210128e20151001xx s 000 0 eng 10.1007/s10994-014-5440-5 doi (NATIONALLICENCE)springer-10.1007/s10994-014-5440-5 Model selection in multivariate adaptive regression splines (MARS) using information complexity as the fitness function [Elektronische Daten] [Elcin Kartal Koc, Hamparsum Bozdogan] This paper introduces information-theoretic measure of complexity (ICOMP) criterion for model selection in multivariate adaptive regression splines (MARS) to tradeoff efficiently between how well the model fits the data and the model complexity. As is well known, MARS is a popular nonparametric regression technique used to study the nonlinear relationship between a response variable and the set of predictors with the help of piecewise linear or cubic splines as basis functions. A critical aspect in determining the form of the nonparametric regression model during the MARS strategy is the evaluation of portfolio of submodels to select the best submodel with the appropriate number of knots over subset of predictors. In the usual regression modeling, when a large number of predictor variables are present in the model, and there is no precise information about the exact functional relationships among the variables, many model selection criteria still overfit the model. In this paper, to find the simplest model that balances the overfitting and underfitting for the model, ICOMP is proposed as a powerful model selection criterion for MARS modeling. Here, the model complexity is treated with respect to the interdependency of parameter estimates, as well as the number of free parameters in the model. We develop and study the performance of ICOMP along with several most popular model selection criteria such as Akaike's information criterion, Schwarz's Bayesian information criterion and generalized cross-validation in MARS modeling to select the best subset models. We provide two Monte Carlo simulation examples and a real benchmark example to demonstrate the utility and versatility of the proposed model selection approach to determine best functional form of the predictive model. Our numerical examples show that ICOMP provides a general model selection criterion with an insight to the interdependencies and/or correlational structure between parameter estimates in the selected model. This new approach can also be applicable to many complex statistical modeling problems. The Author(s), 2014 Model selection nationallicence Multivariate adaptive regression Splines (MARS) nationallicence Nonparametric regression nationallicence Information complexity nationallicence Kartal Koc Elcin Department of Statistics, Operations, and Management Science, The University of Tennessee, 37996, Knoxville, TN, USA aut Bozdogan Hamparsum Department of Statistics, Operations, and Management Science, The University of Tennessee, 37996, Knoxville, TN, USA aut Machine Learning Springer US; http://www.springer-ny.com 101/1-3(2015-10-01), 35-58 0885-6125 101:1-3<35 2015 101 10994 https://doi.org/10.1007/s10994-014-5440-5 text/html Onlinezugriff via DOI BK010053 XK010053 XK010000 Metadata rights reserved Springer special CC-BY-NC licence nationallicence 1 research-article jats NATIONALLICENCE NATIONALLICENCE NL-springer NATIONALLICENCE 856 40 https://doi.org/10.1007/s10994-014-5440-5 text/html Onlinezugriff via DOI NATIONALLICENCE 700 1- Kartal Koc Elcin Department of Statistics, Operations, and Management Science, The University of Tennessee, 37996, Knoxville, TN, USA aut NATIONALLICENCE 700 1- Bozdogan Hamparsum Department of Statistics, Operations, and Management Science, The University of Tennessee, 37996, Knoxville, TN, USA aut NATIONALLICENCE 773 0- Machine Learning Springer US; http://www.springer-ny.com 101/1-3(2015-10-01), 35-58 0885-6125 101:1-3<35 2015 101 10994