Options
Behavior of convergence in logistic regression models : assessing the drop of the Kolmogorov distance between the sampling distribution and the asymptotic distribution of estimators and test statistics in logistic regression analysis
Nold, Mariana Saskia (2014): „Behavior of convergence in logistic regression models : assessing the drop of the Kolmogorov distance between the sampling distribution and the asymptotic distribution of estimators and test statistics in logistic regression analysis“. Bamberg: opus.
Faculty/Professorship:
Author:
Publisher Information:
Year of publication:
2014
Pages:
Supervisor: ;
Heinze, Georg
Language:
English
Remark:
Bamberg, Univ., Diss., 2014
Licence:
Abstract:
Using classical inference, hypothesis tests and confidence intervals are often based on large-sample assumptions, which are said to hold if the sample size is large enough.
The weakness of this approach is, that the researcher does not know what sample size is required for this purpose in a concrete situation.
A common problem that encounters in statistics is the procedure of modeling the relationship between explanatory variables and a binary response. Here logistic regression analysis often represents the appropriate method. This method is used to estimate the probability or odds of occurrence of the binary response in dependence of explanatory variables. But, what is the sample size to be large enough to base statistical conclusions on asymptotic properties?
The type of convergence, with which we are dealing here, is convergence in law, in the following denoted as L-convergence. If the limiting distribution of a statistic is continuous, then L-convergence is equivalent to convergence with respect to the Kolmogorov distance.
Therefore, the Kolmogorov distance is an effective tool for discussing the behavior of L-convergence.
The present work uses an autogenerated process that involves the classical theory of logistic regression analysis to explore the behavior of L-convergence by means of the Kolmogorov distance. Based on the Kolmogorov distance two methods are developed in order to investigate the behavior of L-convergence and its impacts on statistical conclusions. The first serves to extend the spectrum of methods to discuss the impacts of the Firth-penalization, the second to use the classical inference as a more deliberate method with respect to asymptotic properties.
The first method consists of the distance-sample-size-diagram and the accuracy-diagram. The distance-sample-size-diagram represents the mean approximate Kolmogorov distance as a function of the predefined sample size. The predefined sample size is displayed on the horizontal axis and the mean approximate Kolmogorov distance between the statistic of interest and its limiting distribution on the vertical axis. This is a fruitful graphical representation of the behavior of L-convergence in dependence of the rate at which empirical information accrues. Finally the accuracy-diagram presents the actual accuracy function of a confidence interval and its reference derived from asymptotics. This diagram complements the distance-sample-size-diagram as a tool to study the impact of penalizations.
The second method, the p-value-uniform-diagram, shows the actual empirical cumulative distribution function of the p-values of a statical test and the cumulative distribution function of the uniform distribution as the reference of the former. A deviation from this reference indicates that L-convergence is not reached.
The weakness of this approach is, that the researcher does not know what sample size is required for this purpose in a concrete situation.
A common problem that encounters in statistics is the procedure of modeling the relationship between explanatory variables and a binary response. Here logistic regression analysis often represents the appropriate method. This method is used to estimate the probability or odds of occurrence of the binary response in dependence of explanatory variables. But, what is the sample size to be large enough to base statistical conclusions on asymptotic properties?
The type of convergence, with which we are dealing here, is convergence in law, in the following denoted as L-convergence. If the limiting distribution of a statistic is continuous, then L-convergence is equivalent to convergence with respect to the Kolmogorov distance.
Therefore, the Kolmogorov distance is an effective tool for discussing the behavior of L-convergence.
The present work uses an autogenerated process that involves the classical theory of logistic regression analysis to explore the behavior of L-convergence by means of the Kolmogorov distance. Based on the Kolmogorov distance two methods are developed in order to investigate the behavior of L-convergence and its impacts on statistical conclusions. The first serves to extend the spectrum of methods to discuss the impacts of the Firth-penalization, the second to use the classical inference as a more deliberate method with respect to asymptotic properties.
The first method consists of the distance-sample-size-diagram and the accuracy-diagram. The distance-sample-size-diagram represents the mean approximate Kolmogorov distance as a function of the predefined sample size. The predefined sample size is displayed on the horizontal axis and the mean approximate Kolmogorov distance between the statistic of interest and its limiting distribution on the vertical axis. This is a fruitful graphical representation of the behavior of L-convergence in dependence of the rate at which empirical information accrues. Finally the accuracy-diagram presents the actual accuracy function of a confidence interval and its reference derived from asymptotics. This diagram complements the distance-sample-size-diagram as a tool to study the impact of penalizations.
The second method, the p-value-uniform-diagram, shows the actual empirical cumulative distribution function of the p-values of a statical test and the cumulative distribution function of the uniform distribution as the reference of the former. A deviation from this reference indicates that L-convergence is not reached.
GND Keywords: ; ; ;
Regressionsanalyse
Konvergenz
Kolmogorov-System
Statistik
Keywords: ; ; ;
Kolmogorov distance
logistic regression analysis
asymptotic properties
Firth-penalization
DDC Classification:
RVK Classification:
Type:
Doctoralthesis
published:
July 4, 2014
Awards:
Permalink
https://fis.uni-bamberg.de/handle/uniba/6081