Options
Validating an Index of Selection Bias for Proportions in Non‐Probability Samples
Hammon, Angelina; Zinn, Sabine (2025): Validating an Index of Selection Bias for Proportions in Non‐Probability Samples, in: Bamberg: Otto-Friedrich-Universität, S. 499–516.
Faculty/Chair:
Author:
Publisher Information:
Year of publication:
2025
Pages:
Source/Other editions:
International statistical review : a journal of the International Statistical Institute and its associations, Oxford ; Malden, Mass.: Wiley-Blackwell, 2025, Jg. 93, Nr. 3, S. 499–516, ISSN: 0020-8779, 0306-7734, 1751-5823
Year of first publication:
2025
Language:
English
Abstract:
Fast online surveys without sampling frames are becoming increasingly important in survey research. Their recruitment methods result in non-probability samples. As the mechanism of data generation is always unknown in such samples, the problem of non-ignorability arises making vgeneralisation of calculated statistics to the population of interest highly questionable. Sensitivity analyses provide a valuable tool to deal with non-ignorability. They capture the impact of different sample selection mechanisms on target statistics. In 2019, Andridge and colleagues proposed an index to quantify potential (non-ignorable) selection bias in proportions that combines the effects of different selection mechanisms. In this paper, we validate this index with an artificial non-probability sample generated from a large empirical data set and additionally applied it to proportions estimated from data on current political attitudes arising from a real non-probability sample selected via River sampling. We find a number of conditions that must be met for the index to perform meaningfully. When these requirements are fulfilled, the index shows an overall good performance in both of our applications in detecting and correcting present selection bias in estimated proportions. Thus, it provides a powerful measure for evaluating the robustness of results obtained from non-probability samples.
Keywords: ; ; ;
non-ignorable sample selection
pattern-mixture modelling
selection not at random
sensitivity analysis
DDC Classification:
RVK Classification:
Type:
Article
Activation date:
November 17, 2025
Permalink
https://fis.uni-bamberg.de/handle/uniba/111357