A comparative study on the performance of frequentist and Bayesian estimation methods under separation in logistic regression

Authors : Yasin ALTİNİSİK

Pages : 1083-1103

Doi:10.31801/cfsuasmas.614492

View : 17 | Download : 11

Publication Date : 2020-12-31

Article Type : Research Paper

Abstract :Separation is one of the most commonly encountered estimation problems in the context of logistic regression, which often occurs with small and medium sample sizes. The method of maximum likelihood insert ignore into journalissuearticles values(MLE; Fisher ); provides spuriously high parameter estimates and their standard errors under separation in logistic regression. Many researchers in social sciences utilize simple but ad-hoc solutions to overcome this issue, such as `doing nothing strategy`, removing variableinsert ignore into journalissuearticles values(s); from the model, and combining the levels of the categorical variable in the data causing separation etc. The limitations of these basic solutions have motivated researchers to use more appropriate and innovative estimation techniques to deal with the problem. However, the performance and comparison of these techniques have not been fully investigated yet. The main goal of this paper is to close this research gap by comparing the performance of frequentist and Bayesian estimation methods for coping with separation. A simulation study is performed to investigate the performance of asymptotic, bootstrap-based, and Bayesian estimation techniques with respect to bias, precision, and accuracy measures under separation. In line with the simulation study, a real-data example is used to illustrate how to utilize these methods to solve separation in logistic regression.
Keywords : logistic regression, separation problem, frequentist and Bayesian estimation, bias