In many psychological inventories (i.e., personnel selection surveys and diagnostic tests) the collected samples often include fraudulent records. This confronts the researcher with the crucial problem of biases yielded by the usage of standard statistical models. In this paper we applied a recent probabilistic perturbation procedure, called sample generation by replacement (SGR)—(Lombardi and Pastore, Multivar. Behav. Res 47:519–546, 2012), to study the sensitivity of Cronbach’s alpha index to fake perturbations in dichotomous and ordered data, respectively. We used SGR to perform two distinct SGR simulation studies involving two sample size conditions, three item set sizes, and twenty levels of faking perturbations. Moreover, in the second SGR simulation study we also evaluated an additional factor, type of faking model, to study sample reliability under different modulations of graded faking (uniform faking, average faking, slight faking, and extreme faking). To simulate these more complex faking models we proposed a novel extension of the SGR perturbation procedure based on a discrete version of the generalized beta density distribution. We also applied the new procedure to real behavioral data on emotional instability.

The impact of faking on Cronbach's Alpha for dichotomous and ordered rating scores

Lombardi, Luigi
2014-01-01

Abstract

In many psychological inventories (i.e., personnel selection surveys and diagnostic tests) the collected samples often include fraudulent records. This confronts the researcher with the crucial problem of biases yielded by the usage of standard statistical models. In this paper we applied a recent probabilistic perturbation procedure, called sample generation by replacement (SGR)—(Lombardi and Pastore, Multivar. Behav. Res 47:519–546, 2012), to study the sensitivity of Cronbach’s alpha index to fake perturbations in dichotomous and ordered data, respectively. We used SGR to perform two distinct SGR simulation studies involving two sample size conditions, three item set sizes, and twenty levels of faking perturbations. Moreover, in the second SGR simulation study we also evaluated an additional factor, type of faking model, to study sample reliability under different modulations of graded faking (uniform faking, average faking, slight faking, and extreme faking). To simulate these more complex faking models we proposed a novel extension of the SGR perturbation procedure based on a discrete version of the generalized beta density distribution. We also applied the new procedure to real behavioral data on emotional instability.
2014
48
M., Pastore; Lombardi, Luigi
File in questo prodotto:
File Dimensione Formato  
Pastore-Lombardi-2014-numbered.pdf

Solo gestori archivio

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 511.14 kB
Formato Adobe PDF
511.14 kB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/33953
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 15
  • ???jsp.display-item.citation.isi??? 15
social impact