Accuracy of population validity and cross-validity estimation: An empirical comparison of formula-based, traditional empirical, and equal weights procedures

Date

1999-06-01

Author

Raju, NS
Bilgic, R
Edwards, JE
Fleer, PF

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

101
views

0
downloads

An empirical monte carlo study was performed using predictor and criterion data from 84,808 U.S. Air Force enlistees. 501 samples were drawn for each of seven sample size conditions: 25, 40, 60, 80, 100, 150, and 200. Using an eight-predictor model, 500 estimates for each of 9 validity and 11 cross-validity estimation procedures were generated for each sample size condition. These estimates were then compared to the actual squared population validity and cross-validity in terms of mean bias and mean squared bias. For the regression models determined using ordinary least squares, the Ezekiel procedure produced the most accurate estimates of squared population validity (followed by the Smith and the Wherry procedures), and Burket's formula resulted in the best estimates of squared population cross-validity. Other analyses compared the coefficients determined by traditional empirical cross-validation and equal weights; equal weights resulted in no loss of predictive accuracy and less shrinkage. Numerous issues for future basic research on validation and cross-validation are identified.

Subject Keywords

Psychology (miscellaneous), Social Sciences (miscellaneous)

URI

https://hdl.handle.net/11511/67823

Journal

APPLIED PSYCHOLOGICAL MEASUREMENT

DOI

https://doi.org/10.1177/01466219922031220

Collections

Department of Psychology, Article

Suggestions

OpenMETU
Core

Evaluation of environmental parameters in logistic regression models for landslide susceptibility mapping Süzen, Mehmet Lütfi (Informa UK Limited, 2012-01-01) The aim of this study was to determine how well the landslide susceptibility parameters, obtained by data-dependent statistical models, matched with the parameters used in the literature. In order to achieve this goal, 20 different environmental parameters were mapped in a well-studied landslide-prone area, the Asarsuyu catchment in northwest Turkey. A total of 4400 seed cells were generated from 47 different landslides and merged with different attributes of 20 different environmental causative variables i...
Predicting applicant withdrawal: An expectancy theory perspective Acikgoz, Yalcin; Sümer, Hayriye Canan (Informa UK Limited, 2018-01-01) The purpose of this study was to examine the predictors of withdrawal from the job application process. To this end, this study used expectancy theory as its theoretical framework. Using data from 5,346 applicants to an entry-level military position in a large European military organization, results indicated that a positive change in job attraction, applicant emotional stability, and conscientiousness, and the amount of information and self-efficacy regarding selection procedures all had negative relations...
Conjoint Use of Regression Analysis and Functional Measurement to Test Models of Combination of Factors Predicting Negative Attitude to Women Bugay, Asli; Delevi, Rakel; Mullet, Etienne (Editorial Pontificia Universidad Javeriana, 2019-01-01) The present study was aimed at showing that by conjointly using two techniques that are rarely used in combination - regression analysis and functional measurement, it may be possible to rigorously tests models of combination of factors using data obtained in traditional multi-item/multi-scale surveys. The data used for this demonstration were taken from a large survey (N = 3,235) of Turkish students' attitude to women (ATW). As it included 12 types of predictors (e.g., age, geographic location, score on co...
Gray's value-puralism: a critical analysis Parmaksız, Abdullah Umut; Üstüner, Fahriye ; Department of Psychology (2007) In this study, John Gray’s theory of value-pluralism is critically analyzed. Gray’s modus vivendi, based on Isaiah Berlin’s criticism of monism, is a theory that aims to create the conditions in which peace and diversity in late-modern societies can be protected. Gray argues that a legally pluralistic system where collectives have autonomy is more serving to peace than its liberal alternatives. This study argues that Gray fails to achieve its goal of promoting diversity. This is due to the fact that Gray’s ...
Associated factors of suicide among university students: Importance of family environment Gençöz, Tülin (Springer Science and Business Media LLC, 2006-06-01) The aim in this study was to underline the importance of family environment as a significant associate of suicide probability among university students. For this aim 226 Turkish university students completed Suicide Probability Scale, Family Environment Questionnaire, Beck Depression Inventory, and Positive and Negative Affect Scale. As a result of the formulated regression analysis, after controlling for the 51% of the total variance accounted for by the control variables (i.e., gender, age, living with fa...

Citation Formats

N. Raju, R. Bilgic, J. Edwards, and P. Fleer, “Accuracy of population validity and cross-validity estimation: An empirical comparison of formula-based, traditional empirical, and equal weights procedures,” APPLIED PSYCHOLOGICAL MEASUREMENT, pp. 99–115, 1999, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/67823.