Papers by Hannah Rothstein
Introduction to Meta-Analysis
Introduction to Meta-Analysis
Journal of clinical epidemiology, Jan 29, 2017
This paper reviews the available evidence and guidance on methods to identify reports of quasi-ex... more This paper reviews the available evidence and guidance on methods to identify reports of quasi-experimental (QE) studies to inform systematic reviews of health care, public health, international development, education, crime and justice, and social welfare. Research, guidance and examples of search strategies were identified by searching a range of databases, key guidance documents, selected reviews, conference proceedings and personal communication. Current practice and research evidence were summarised. 4914 records were retrieved by database searches and additional documents were obtained by other searches. QE studies are challenging to identify efficiently because they have no standardized nomenclature and may be indexed in various ways. Reliable search filters are not available. There is a lack of specific resources devoted to collecting QE studies and little evidence on where best to search. Searches to identify QE studies should search a range of resources and, until indexing...
Research synthesis methods, 2017
When we speak about heterogeneity in a meta-analysis, our intent is usually to understand the sub... more When we speak about heterogeneity in a meta-analysis, our intent is usually to understand the substantive implications of the heterogeneity. If an intervention yields a mean effect size of 50 points, we want to know if the effect size in different populations varies from 40 to 60, or from 10 to 90, because this speaks to the potential utility of the intervention. While there is a common belief that the I(2) statistic provides this information, it actually does not. In this example, if we are told that I(2) is 50%, we have no way of knowing if the effects range from 40 to 60, or from 10 to 90, or across some other range. Rather, if we want to communicate the predicted range of effects, then we should simply report this range. This gives readers the information they think is being captured by I(2) and does so in a way that is concise and unambiguous. Copyright © 2017 John Wiley & Sons, Ltd.
Personnel Psychology, 1999
This research showed that the validity of a biodata instrument developed and keyed within a singl... more This research showed that the validity of a biodata instrument developed and keyed within a single organization can generalize to other organizations. It also examines a criterion measure-rate of promotional progress-that has not been used extensively in biodata research, but has several characteristics that make its use attractive. The validity of the biodata component of the Manager Profile Record (MPR), developed and keyed within a single organization, as a predictor of rate of managerial progress was cross-validated on a sample of 7,334 managers and staff professionals in 24 organizations. Results indicate the MPR was a valid predictor of rate of promotional progress across all organizations and that validity did not vary greatly across organizations ( p = .53, SO, = .05). The MPR was also a valid predictor for both sexes, as well as for managers of all age groups, lengths of company service, and education levels. These findings demonstrate that multiple-firm development and keying of a biodata instrument was not required for generalizable validity, and argue against the hypothesis of situational specificity. Suggestions for developing biodata instruments in single organizations that will generalize to other organizations include careful attention to the validity and reliability of criterion measures and developing validity at the item level. COPYRIGHT 0 1999 PERSONNEL PSYCHOLOGY, INC. 'In addition to the biodata component investigated here, the complete Manager Profile Record contains a judgment questionnaire and a perception questionnaire. The Manager Profile Record is described in detail in Richardson, Bellows, Henry, and Co. (1992).
Journal of Managerial Psychology, Jan 1, 1988
This article describes a new procedure for evaluating the training and experience of job candidat... more This article describes a new procedure for evaluating the training and experience of job candidates developed at the United States Civil Service Commission (now the Office of Personnel Management). It is based, in part, on a technical report by Schmidt, Caplan, Bemis, ...
Journal of Business Ethics, Jan 1, 2006
Test critiques, Jan 1, 1984
Journal of Business and Psychology, Jan 1, 1987
In the field of Industrial/Organizational Psychology, there has been an explosion in new knowledg... more In the field of Industrial/Organizational Psychology, there has been an explosion in new knowledge and the ability to apply that knowledge during the past ten years. Where textbooks of the early to mid 1970's (Campbell, Dunnette, Lawler & Weick, 1970; Goldstein, 1974; Schneider, ...
Organizational …, Jan 1, 2011
The authors examined the degree to which meta-analyses in the organizational sciences transparent... more The authors examined the degree to which meta-analyses in the organizational sciences transparently report procedures, decisions, and judgment calls by systematically reviewing all (198) meta-analyses published between 1995 and 2008 in 11 top journals that publish meta-analyses in industrial and organizational psychology and organizational behavior. The authors extracted information on 54 features of each meta-analysis. On average, the meta-analyses in the sample provided 52.8% of the information needed to replicate the meta-analysis or to assess its validity and 67.6% of the information considered to be most important according to expert meta-analysts. More recently published meta-analyses exhibited somewhat more transparent reporting practices than older ones did. Overall transparency of reporting (but not reporting of the most important items) was associated with higher ranked journals; transparency was not significantly related to number of citations. The authors discuss the implications of inadequate reporting of meta-analyses for development of cumulative knowledge and effective practice and make suggestions for improving the current state of affairs.
…, Jan 1, 2003
... Trials in Social Science was cosponsored by the American Academy of Political and Social Scie... more ... Trials in Social Science was cosponsored by the American Academy of Political and Social Science, which has more than a century ... at the University of Pennsylvania, founded by a corporate executive in an industry (broadcasting) that is highly dependent on good social science ...
Abstract : Data on the Federal Criminal Investigating Series were taken from the Central Personne... more Abstract : Data on the Federal Criminal Investigating Series were taken from the Central Personnel Data File (the main repository for employment history and demographic information of Federal civilian employees), for 1977-1980. Four year trends in the size and race/sex composition ...
media.johnwiley.com.au
... 35 Jesse A. Berlin and Davina Ghersi Chapter 4 Grey Literature and Systematic Reviews 49 ... ... more ... 35 Jesse A. Berlin and Davina Ghersi Chapter 4 Grey Literature and Systematic Reviews 49 ... 73 Chapter 5 The Funnel Plot 75 Jonathan AC Sterne, Betsy Jane Becker and Matthias Egger Chapter 6 Regression Methods to Detect Publication and Other Bias in Meta-Analysis 99 ...
Computing effect sizes for meta-analysis BORENSTEIN Michael Dr, HEDGES Larry V, HIGGINS Julian PT... more Computing effect sizes for meta-analysis BORENSTEIN Michael Dr, HEDGES Larry V, HIGGINS Julian PT Dr, ROTHSTEIN Hannah R.
Uploads
Papers by Hannah Rothstein