Random Ensemble MARS: Model Selection in Multivariate Adaptive Regression Splines Using Random Forest Approach

Authors : Dilek SABANCI, Mehmet Ali CENGİZ

Pages : 27-45

Doi:10.53570/jnt.1147323

View : 15 | Download : 10

Publication Date : 2022-09-30

Article Type : Research Paper

Abstract :Multivariate Adaptive Regression Splines insert ignore into journalissuearticles values(MARS); is a supervised learning model in machine learning, not obtained by an ensemble learning method. Ensemble learning methods are gathered from samples comprising hundreds or thousands of learners that serve the common purpose of improving the stability and accuracy of machine learning algorithms. This study presented REMARS insert ignore into journalissuearticles values(Random Ensemble MARS);, a new MARS model selection approach obtained using the Random Forest insert ignore into journalissuearticles values(RF); algorithm. 200 training and test data set generated via the Bagging method were analysed in the MARS analysis engine. At the end of the analysis, two different MARS model sets were created, one yielding the smallest Mean Square Error for the test data insert ignore into journalissuearticles values(Test MSE); and the other yielding the smallest Generalised Cross-Validation insert ignore into journalissuearticles values(GCV); value. The best model was estimated for both Test MSE and GCV criteria by examining the error of measurement criteria, variable importance averages, and frequencies of the knot values for each model. Eventually, a new model was obtained via the ensemble learning method, i.e., REMARS, that yields result as good as the MARS model obtained from the original data set. The MARS model, which works better in the larger data set, provides more reliable results with smaller data sets utilising the proposed method.
Keywords : Multivariate Adaptive Regression Splines, Random Forest, Model Selection, Machine Learning, Ensemble Learning