Papers by Kimberly Barchard
Psychological Assessment, Dec 1, 2015
There is disagreement on whether attention-deficit/hyperactivity disorder (ADHD) symptoms are bes... more There is disagreement on whether attention-deficit/hyperactivity disorder (ADHD) symptoms are best characterized along two dimensions consisting of inattention and hyperactivity/impulsivity or three dimensions where hyperactivity and impulsivity are separate. To address this, the current study investigated the underlying symptom dimensions of ADHD by examining two-and three-factor models of ADHD symptom ratings in 400 children and adolescents diagnosed with ADHD. ADHD symptom ratings for each of the 18 DSM-IV Criteria A symptoms were obtained from mothers using a standardized symptom rating scale. Confirmatory factor analysis (CFA) was used to examine whether the 18 symptoms were best explained by two or three latent constructs. Results of the CFA demonstrated that a three-factor model was superior to a two-factor model. Findings support three distinct symptom dimensions that are consistent with previous research demonstrating unique clinical presentations of inattention, hyperactivity, and impulsivity. Differentiating between these three domains may aid in predicting behavioral outcomes in children with ADHD.
PubMed, 2006
Consensus scoring occurs when the scoring key for a test is based upon the responses of the norm ... more Consensus scoring occurs when the scoring key for a test is based upon the responses of the norm group. Consensus scoring is an attractive alternative to traditional methods of creating a scoring key for ability tests, especially useful when experts disagree about the correct answers to test items, as they do in the area of emotions and emotion perception. Of the many variations of consensus scoring, mode consensus scoring (the most frequent response in a norm group is given a score of 1, and all other responses a score of 0) and proportion consensus scoring (each respondent's score on an item is equal to the proportion of the norm group who match the respondent's answer) are the most widely used and the most psychometrically promising. This paper demonstrates that mode consensus scoring is biased against smaller sub-groups within the norm group: when sub-groups differ in their modal responses, the size of the sub-groups will influence the average group score. No known scoring option eliminates this bias. In contrast, proportion consensus scoring is not necessarily biased against smaller groups, although bias does occur in some extreme situations. Proportion consensus scoring is therefore the preferred consensus scoring option at this time.
Emotional Intelligence is a multi-faceted construct. Existing tests do a good job of measuring so... more Emotional Intelligence is a multi-faceted construct. Existing tests do a good job of measuring some aspects of Emotional Intelligence. The Metaphors Test (Barchard, 2004) was designed to measure the ability to decipher the emotional content of ambiguous sentences. This test may measure a new facet of Emotional Intelligence. The purpose of this research was to examine the construct validity of the Metaphors Test as a measure of Emotional Intelligence. Using a sample of 281 undergraduates, the Metaphors Test was correlated with the four branches of the Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT; Mayer, Salovey, & Caruso, 2004): Perceiving Emotions, Using Emotions to Facilitate Thought, Understanding Emotions, and Managing Emotions. The four correlations were all moderate, positive, and statistically significant. These results provide promising evidence of construct validity. Future research should select the items with the highest correlations with the MSCEIT. This will enable researchers to create a revised, shorter version of the Metaphors Test with higher construct validity.
Frontiers in Psychology, Aug 4, 2023
Introduction: There is a need to psychometrically develop assessment instruments capable of scree... more Introduction: There is a need to psychometrically develop assessment instruments capable of screening mental health disorders in athlete populations. The current study was conducted to determine reliability, validity and clinical utility of the Mental Health Disorders Screening Instrument for Athletes (MHDSIA). Methods and results: 259 collegiate athletes completed the MHDSIA. Factor analysis determined a single factor with good internal consistency, and this factor was positively correlated with an established measure of psychiatric symptomology (Symptom Checklist 90-R), demonstrating its concurrent validity. An optimum clinical cutoff score (i.e., 32) was determined using Receiver Operating Characteristic (ROC) analyses to assist appropriate mental health referrals. Discussion: Results suggest the MHSIA is a reliable, valid, and relatively quick and easy to interpret screen for the broad spectrum of mental health disorders in collegiate athletes. As expected, NCAA athletes reported lower MHDSIA scores than club and intramural athletes, while males reported similar severity scores as females.
PsycEXTRA Dataset, 2010
Page 1. 1 Emotional Awareness: Computer and Hand Scoring of an Open-Ended Test Kimberly A. Barcha... more Page 1. 1 Emotional Awareness: Computer and Hand Scoring of an Open-Ended Test Kimberly A. Barchard a , Richard D. Lane b , and Bryan D. Watson a ... International Journal of Eating Disorders, 37, 321-329. doi:10.1002/eat.20132 Ciarrochi, J., Caputi, P., & Mayer, JD (2003). ...
Multivariate Behavioral Research, Jun 6, 2016
ABSTRACT Researchers now know that when theoretical reliability increases, power can increase, de... more ABSTRACT Researchers now know that when theoretical reliability increases, power can increase, decrease, or stay the same. However, no analytic research has examined the relationship of power to the most commonly used type of reliability—internal consistency—and the most commonly used measures of internal consistency, coefficient alpha and ICC(A,k). We examine the relationship between the power of independent samples t tests and internal consistency. We explicate the mathematical model upon which researchers usually calculate internal consistency, one in which total scores are calculated as the sum of observed scores on K measures. Using this model, we derive a new formula for effect size to show that power and internal consistency are influenced by many of the same parameters but not always in the same direction. Changing an experiment in one way (e.g., lengthening the measure) is likely to influence multiple parameters simultaneously; thus, there are no simple relationships between such changes and internal consistency or power. If researchers revise measures to increase internal consistency, this might not increase power. To increase power, researchers should increase sample size, select measures that assess areas where group differences are largest, and use more powerful statistical procedures (e.g., ANCOVA).
Journal of Attention Disorders, Oct 16, 2012
Schizophrenia Research, May 1, 2013
The assessment of premorbid adjustment in schizophrenia has received considerable attention becau... more The assessment of premorbid adjustment in schizophrenia has received considerable attention because of models suggesting that schizophrenia is a neurodevelopmental disorder characterized by abnormalities in functioning prior to onset of the disorder. Some studies suggest that premorbid adjustment is best viewed as a multidimensional construct where different areas of functioning might be differentially impacted by the illness and sex. The current study examined these matters using of Premorbid Adjustment Scale (PAS) in a sample of 421 individuals with schizophrenia. Confirmatory factory analyses conducted for three developmental periods (childhood, early adolescence, late adolescence) and for males and females separately, indicated that the PAS consists of academic and social factors that are invariant across developmental period and sex. Differences in severity of academic and social premorbid impairment were also present between males and females across developmental periods. Findings suggest important differences between males and females in the course of premorbid deterioration prior to onset of schizophrenia.
Schizophrenia Research, Dec 1, 2022
Computers in Human Behavior, Sep 1, 2013
ABSTRACT Data entry errors can have catastrophic effects on the results of a statistical analysis... more ABSTRACT Data entry errors can have catastrophic effects on the results of a statistical analysis. Therefore, researchers often spend considerable effort checking their data. This paper compared the effectiveness of three data checking methods – double entry, read aloud, and visual checking – using the types of data and data entry personnel that are typically used in psychological research. To compare these techniques, we created 20 data sheets and entered them into the computer. Next, we deliberately introduced errors into this data set. Participants’ job was to locate and correct these errors.A total of 340 undergraduates participated in this study. Of these, 80 had previous data entry experience and 260 did not. Double entry was far superior to read aloud and visual checking, both among people with previous data entry experience and among people without previous experience. Among people with no previous experience, read aloud and visual checking had more than 20 times as many errors as double entry. In addition, double entry was preferred over visual checking. Thus, although double entry takes slightly longer, it is clearly worth the extra effort.
Journal of Consulting and Clinical Psychology, Jun 1, 2013
Objective-The Psychopathy Checklist-Revised (PCL-R; Hare, 1991, 2003) is often used to assess ris... more Objective-The Psychopathy Checklist-Revised (PCL-R; Hare, 1991, 2003) is often used to assess risk of violence, perhaps based on the assumption that it captures emotionally detached individuals who are driven to prey upon others. This study is designed to assess the relation between (a) core interpersonal and affective traits of psychopathy and impulsive antisociality on the one hand, and (b) the risk of future violence, and patterns of motivation for past violence, on the other. Method-A research team reliably assessed a sample of 158 male offenders for psychopathy, using both the interview-based PCL-R and the self-report Psychopathic Personality Inventory (PPI: Lilienfeld & Andrews, 1996). Then, a second, independent research team assessed offenders' lifetime patterns of violence and its motivation. After these baseline assessments, offenders were followed in prison and/or the community for up to one year to assess their involvement in three different forms of violence. Baseline and follow-up assessments included both interviews and reviews of official records. Results-First, the PPI manifested incremental validity in predicting future violence over the PCL-R (but not vice versa)-and most of its predictive power derived solely from impulsive antisociality. Second, impulsive antisociality-not interpersonal and affective traits specific to psychopathy-were uniquely associated with instrumental lifetime patterns of past violence. The latter psychopathic traits are narrowly associated with deficits in motivation for violence (e.g., lack of fear; lack of provocation). Conclusion-These findings and their consistency with some past research advise against broad generalizations about the relation between psychopathy and violence.
European Archives of Psychiatry and Clinical Neuroscience, Jan 12, 2023
Child Neuropsychology, Oct 11, 2016
Behavior Research Methods, May 1, 2010
is an open-ended test of the ability to use emotion words in a complex and differentiated fashion... more is an open-ended test of the ability to use emotion words in a complex and differentiated fashion. Respondents describe how they and another person would feel in 20 emotionally evocative situations. Because the LEAS is open-ended, it takes a long time to score. In the first author's lab, training a new LEAS scorer can take up to 10 h. Once trained, LEAS scorers can take up to 20 min for each respondent. Thus, a new scorer may take up to 43 h to score the LEAS for 100 respondents, and an experienced and efficient LEAS scorer will still take 10 min per respondent or roughly 17 h for 100. The amount of time involved in scoring is likely the primary reason that researchers have not used the LEAS more often. To address this issue, Lane et al. (1990) advocated automating the LEAS. The purpose of the present project was to implement this suggestion: We developed a free computer program to score the LEAS, and in this article we assess the validity of the scores that this program produces. Before describing the scoring program, we first describe emotional awareness and the LEAS in more detail. The Levels of Emotional Awareness Scale Being aware of emotional experiences in the self and in others is perhaps the most fundamental of emotional intelligence skills (Lane, 2000). Individuals with higher emotional awareness have at their disposal complex and differentiated emotion information, which can be used to support higher level emotion processes such as understanding and managing emotions and using emotions to facilitate cognition. As would be expected, lower levels of emotional awareness are related to a number of clinical conditions. LEAS scores are lower in people with somatoform disorders (
JAMA Psychiatry, Dec 1, 2018
IMPORTANCE Negative symptoms are associated with a range of poor clinical outcomes, and currently... more IMPORTANCE Negative symptoms are associated with a range of poor clinical outcomes, and currently available treatments generally do not produce a clinically meaningful response. Limited treatment progress may be owing in part to poor clarity regarding latent structure. Prior studies have inferred latent structure using exploratory factor analysis, which has led to the conclusion that there are 2 dimensions reflecting motivation and pleasure (MAP) and diminished expressivity (EXP) factors. However, whether these conclusions are statistically justified remains unclear because exploratory factor analysis does not test latent structure. Confirmatory factor analysis (CFA) is needed to test competing models regarding the latent structure of a construct. OBJECTIVE To evaluate the fit of 4 models of the latent structure of negative symptoms in schizophrenia using CFA. DESIGN, SETTING, AND PARTICIPANTS Three cross-sectional studies were conducted on outpatients with schizophrenia who were rated on the 3 most conceptually contemporary measures: Scale for the Assessment of Negative Symptoms (SANS), Brief Negative Symptom Scale (BNSS), and Clinical Assessment Interview for Negative Symptoms (CAINS). Confirmatory factor analysis evaluated the following 4 models: (1) a 1-factor model; (2) a 2-factor model with EXP and MAP factors; (3) a 5-factor model with separate factors for the 5 domains of the National Institute of Mental Health consensus development conference (blunted affect, alogia, anhedonia, avolition, and asociality); and (4) a hierarchical model with 2 second-order factors reflecting EXP and MAP and 5 first-order factors reflecting the 5 consensus domains. MAIN OUTCOMES AND MEASURES Outcomes included CFA model fit statistics derived from symptom severity scores on the SANS, BNSS, and CAINS. RESULTS The study population included 860 outpatients with schizophrenia (68.0% male; mean [SD] age, 43.0 [11.4] years). Confirmatory factor analysis was conducted on each scale, including 268 patients for the SANS, 192 for the BNSS, and 400 for the CAINS. The 1-and 2-factor models provided poor fit for the SANS, BNSS, and CAINS as indicated by comparative fit indexes (CFIs) and Tucker Lewis indexes (TLIs) less than 0.950, RMSEAs that exceeded the 0.080 threshold, and WRMRs greater than 1.00. The 5-factor and hierarchical models provided excellent fit, with the 5-factor model being more parsimonious. The CFIs and TLIs met the 0.95 threshold and the 1.00 threshold for both factor models with all 3 measures. Interestingly, the RMSEAs for the 5-factor model and the hierarchical model fell under the 0.08 threshold for the BNSS and the CAINS but not the SANS. CONCLUSIONS AND RELEVANCE These findings suggest that the recent trend toward conceptualizing the latent structure of negative symptoms as 2 distinct dimensions does not adequately capture the complexity of the construct. The latent structure of negative symptoms is best conceptualized in relation to the 5 consensus domains. Implications for identifying pathophysiological mechanisms and targeted treatments are discussed.
Data quality is critical to reaching correct research conclusions. Previous research has demonstr... more Data quality is critical to reaching correct research conclusions. Previous research has demonstrated that some methods of data checking are better than others, but not all researchers use the best methods. The purpose of this study was to examine the relationship between perceived data quality and actual data quality. A total of 29 participants completed this study. Participants checked that letters and numbers had been entered correctly into the computer using one of three randomly assigned data checking methods. Afterwards, they rated the quality of their data checking method. The sample correlations between perceived and actual data quality were small to moderate and confidence intervals for the population correlations did not include high values. We conclude that the relationship between actual and perceived data quality is not high. Researchers should not trust their subjective evaluations data checking effectiveness: They need empirical evidence of the quality of their data checking.
Applied neuropsychology. Child, Mar 23, 2020
Objective: Short forms of standard intelligence tests are useful in clinical and research setting... more Objective: Short forms of standard intelligence tests are useful in clinical and research settings where administration of a full intelligence test is impractical or unnecessary. In cross cultural contexts where few tests are available, including brief intelligence tests, short forms may be particularly useful to meet clinical and research needs. However, there is little cross-cultural research on the validity of short forms. This study evaluated feasibility of short form development for the Spanish version of the Wechsler Intelligence Scale for Children-Fourth Edition (WISC-IV) and examined comparability of short-form IQ estimates in Spanish-and English-speaking children with Attention-Deficit/Hyperactivity Disorder (ADHD). Method: Participants included children with ADHD who were administered the WISC-IV Spanish (n ¼ 165) or WISC-IV (n ¼ 299). Full Scale IQs (FSIQs) were calculated for two-, three-, four-, and five-subtest short forms. Misclassification rates, mean absolute differences, and intraclass correlation coefficients (ICCs) were used to determine short form accuracy in estimating FSIQ. Results: The WISC-IV short forms examined had generally strong psychometric properties (e.g., ICCs ranged from .78 to .94) and level of accuracy in estimating FSIQ did not differ across primary language of Spanish or English. Conclusions: Findings support feasibility of IQ short form development to help address mental health disparities in research and clinical screening for Spanish-and English-speaking pediatric populations with ADHD.
Archives of Clinical Neuropsychology, Aug 31, 2016
Objective: The Wechsler Intelligence Scale for Children-Fourth Edition Spanish (WISC-IV-S) is a t... more Objective: The Wechsler Intelligence Scale for Children-Fourth Edition Spanish (WISC-IV-S) is a translation and adaptation of the WISC-IV and is often used to evaluate children and adolescents when Attention-Deficit/Hyperactivity Disorder (ADHD) or learning disorder (LD) is suspected. Factor analysis of the WISC-IV-S normative sample identified four factors, suggesting that its factor structure is similar to that found for English-speaking populations. However, there is limited information on the factor structure of the WISC-IV-S when used with clinical populations. The present study examined the factor structure of the WISC-IV-S in a clinical sample of children of Puerto Rican descent. Method: The sample included 145 children who were Spanish-speaking, Puerto Rico residents, and had been administered the WISC-IV-S as part of a clinical evaluation (Mean age = 10.23 years; SD = 2.85). All children included in the analyses had a diagnosis of ADHD or LD. Confirmatory factor analyses (CFA) were performed to evaluate if the WISC-IV-S was best explained by a two-, three-, four-, or five-factor model based on the Cattell-Horn-Carroll theory. Results: The CFA results demonstrated that the four-factor model provided the best fit for the data (e.g., Comparative Fit Index = .950; Root Mean Square Error of Approximation = .053, 95% CI [.000, .089]). Conclusion: Findings support the four-factor structural validity of the WISC-IV-S in Puerto Rican children with ADHD or LD. Future studies should continue to examine its factor structure across understudied clinical populations, including larger samples, to address gaps in cross-cultural measurement validity.
This study compared the effectiveness of simulation-based instruction to traditional teacher-dire... more This study compared the effectiveness of simulation-based instruction to traditional teacher-directed instruction about water resource management in Las Vegas. Subjects, undergraduate students recruited from Psychology and Environmental Studies departments, participated in one of two treatments. All participants were given a pretest prior to instruction, a post-test immediately following instruction, and a retention-test 4 weeks after instruction. Evaluation instruments provided overall scores, gauged student learning in topic areas and different question difficulty-levels as well as attitudes toward the environment and water management. The treatments differed only in how students interacted with the system after receiving background information on Las Vegas valley's water issues. Students in the traditional group used a lecture format presentation of graphed results to show affects of changes to the system, while the students in the simulation-based group manipulated the inter...
Uploads
Papers by Kimberly Barchard