Papers by Sébastien Béland
Dans le contextes des enquêtes, il arrive fréquemment que les répondants ne fournissent pas néces... more Dans le contextes des enquêtes, il arrive fréquemment que les répondants ne fournissent pas nécessairement des réponses appropriées. C'est le cas notamment en ce qui a trait aux cas de fraudes dans les épreuves d'évaluation des habiletés disciplinaires. À cette fin, des modèles psychométriques ont été proposés pour corriger le résultat d'un étudiant malgré ses tentatives de fraudes. Ces modèles reposent toutefois uniquement sur des réponses de type dichotomique ou seulement une bonne ou une mauvaise réponse est considérée. Ces comportements de fraude sont également présents à l'intérieur des enquêtes d'opinion qui s'intéressent aux perceptions des répondants. La plupart du temps les réponses à ces enquêtes présentent plus d'un choix de réponses et sont alors dits polytomiques. Récemment, de nouvelles modélisations appropriées pour ce type de réponses ont été proposées. Elles seront présentées et accompagnées d'exemples d'application
Frequently, candidates at aptitude multiple choice test miss attention, motivation or preparation... more Frequently, candidates at aptitude multiple choice test miss attention, motivation or preparation and show underachievement or overachievement. Similarly, at surveys respondents show frequently misfitting patterns of responses. Their result does not correspond any more to their true aptitude or attitude, an inappropriate response pattern being obtained. New multidimensional models specific to polytomous responses circumvent these situations and diminish considerably the associated person bias. Multidimensional polytomous item response models adding new person parameters to the trait of the candidate are proposed. In the spirit of previous Raiche’s dichotomous responses IRT propositions, like the discrimination and don’t know item parameters, these models offer fluctuation and don’t know person parameters. Estimation methods, results from simulation showing the efficacy of these models and recommendations for the design of testing situations will be presented
Studies about Person-fit are generally produced under a frequentist approach. For example, Meijer... more Studies about Person-fit are generally produced under a frequentist approach. For example, Meijer & Sijtsma (2001) discussed many parametric and non-parametric indexes in their review on this topic. However, it exists also few papers about the investigation of person-fit in a Bayesian context (e.g. Glas & Meijer, 2003; Van Der Linden & Guo, 2008). In this talk, we present a new method based on the evaluation of informative hypotheses using the Bayes factor. This approach is non-parametric in nature and can be applied to a large variety of situations and many types of data. Here, we focus on the use of Bayesian person-fit methods that can be used with polytomous response data. This presentation is divided in two sections. First, we present the technical aspects of this approach by discussing some hypotheses of interest, the nature of the prior and the nature of the posterior. Second, we present results from a real data matrix. The first analysis shows that Bayesian person-fit evaluation is efficient and can be easily applied to small data matrices
Several authors (Molenaar & Hoijtink, 1990; Meijer & Sijtsma, 2001) have shown that sever... more Several authors (Molenaar & Hoijtink, 1990; Meijer & Sijtsma, 2001) have shown that several person-fit statistics present some important limitations. One issue is that the distribution of some parametric person-fit statistics is unknown. Another important issue is that the distribution of person-fit indexes is most often derived under the true ability level. In this situation, replacing the true ability by some estimate can seriously affect the distribution of these indexes. Snijders (2001) proposed a method to correct the mean and the variance of many parametric person-fit statistics to be approximately standard normally distributed, and derived the corrected version of the lz index. The purpose of this paper is to apply this correction to other well-known parametric indexes, and to compare them with their classical versions. The simulation results indicate that the standardized indexes have empirical type I errors close to the nominal significance level, and that the corrected indexes outperform their classical versions in this regard
Le carré-moyen non-pondéré U comme indice de détection (unweighted mean square statistics) (Wrigh... more Le carré-moyen non-pondéré U comme indice de détection (unweighted mean square statistics) (Wright & Stone, 1979) et sa version standardisée ZU (Wright, 1980) sont parmi les indices de détection de patrons de réponse inappropriés paramétriques les plus connus. On retrouve l’un et/ou l’autre de ces indices dans des logiciels commerciaux ou gratuits tels que RUMM2030, FACETS ou la librairie R eRm en plus d’en faire mention dans les articles les plus cités sur le sujet (Karabatsos, 2003; Meijer et Sijtsma, 2001). Durant les dernières décennies, quelques voix se sont élevées afin de sensibiliser les utilisateurs aux problèmes que présentent U et ZU (Karabatsos, 2000; Smith, 1991). Ils semblent, en effet, présenter des scores extrêmes qui rendraient leur utilisation inadéquate dans certaines situations. Cette présentation aura comme objectif d’étudier les limites des indices U et ZU. Nous utiliserons une étude de simulation et différents modèles de réponses à l’item dichotomiques afin de soutenir notre propos. Les auteurs de l’étude concluront leur présentation en discutant de l’importance de manipuler ces indices avec précaution.Peer reviewe
Journal of Health Care for the Poor and Underserved
Mini-Med Schools (MiMS) are an opportunity for health sciences and social work undergraduates to ... more Mini-Med Schools (MiMS) are an opportunity for health sciences and social work undergraduates to discuss health-related topics with Innu and Atikamekw youth in Canada. More than 500 undergraduates and 1,000 students have taken part in the project since its beginning in 2011. This study aims to assess the impact of both 1) MiMS's predeparture training and 2) the MiMS themselves on undergraduates' prejudices toward Indigenous peoples. Satisfaction of the undergraduates taking part in the activity was also assessed. Seventy-eight undergraduates were recruited and completed the Old-fashioned and Modern Prejudiced Attitudes Toward Aboriginals Scales (O-PATAS and M-PATAS) at baseline, after the pre-departure training, and after the MiMS. They also completed satisfaction surveys. This study shows a reduction of prejudices after participating to a MiMS, but no effect of a pre-departure training. The activities were overall appreciated by undergraduates and most of them would like to take part again in the MiMS.
BMC Medical Education
Background Multiple mini-interviews (MMI) are used to assess non-academic attributes for selectio... more Background Multiple mini-interviews (MMI) are used to assess non-academic attributes for selection in medicine and other healthcare professions. It remains unclear if different MMI station formats (discussions, role-plays, collaboration) assess different dimensions. Methods Based on station formats of the 2018 and 2019 Integrated French MMI (IFMMI), which comprised five discussions, three role-plays and two collaboration stations, the authors performed confirmatory factor analysis (CFA) using the lavaan 0.6-5 R package and compared a one-factor solution to a three-factor solution for scores of the 2018 (n = 1438) and 2019 (n = 1440) cohorts of the IFMMI across three medical schools in Quebec, Canada. Results The three-factor solution was retained, with discussions, role-plays and collaboration stations all loading adequately with their scores. Furthermore, all three factors had moderate-to-high covariance (range 0.44 to 0.64). The model fit was also excellent with a Comparative fit ...
Presses de l'Université du Québec eBooks, Jan 25, 2023
Presses de l'Université du Québec eBooks, Jan 25, 2023
Presses de l'Université du Québec eBooks, Jan 25, 2023
Revue des sciences de l'éducation
Le présent article est une exemplification méthodologique de l’utilisation des graphiques Johnson... more Le présent article est une exemplification méthodologique de l’utilisation des graphiques Johnson-Neyman pour interpréter l’effet d’interaction entre variables latentes. Il fait suite à l’exemplification méthodologique de Girard et Béland (2017) et apporte certaines mises à jour au regard des analyses précédemment exemplifiées. De plus, il propose une autre façon d’interpréter l’effet d’interaction qui comporte des avantages en comparaison avec la méthode « sélection d’un point ».
Revue internationale de pédagogie de l’enseignement supérieur
Higher Education, Skills and Work-Based Learning
PurposeWhile training students to new literacy and critical thinking has been recognized for seve... more PurposeWhile training students to new literacy and critical thinking has been recognized for several decades, it seems even more crucial today as education is presented as a lever to fight against fake news. Preservice teachers, both so-called digital natives at the cutting edge of the social web and tomorrow’s educators, represent a useful object of study. The purpose of this paper is to describe preservice teachers’ critical thinking skills scores notably regarding environmental factors (training type, country of study and employment) and personal determinants (metaliteracy self-efficacy and belief in the likelihood to become a teacher) in three French-speaking nations (Wallonia, France and Quebec).Design/methodology/approachUsing a quantitative methodology, this article is part of sequential mixed design research aiming to describe the level of preservice teachers’ (n = 245) critical thinking in three French-speaking nations: Wallonia, France and Quebec. This study aimed to see t...
This paper presents an introduction into Bayesian evaluation of informative hypotheses, that is, ... more This paper presents an introduction into Bayesian evaluation of informative hypotheses, that is, hypotheses representing explicit expectations about multiple group means (Hoijtink, 2011; Hoijtink, Klugkist & Boelen, 2008). The authors begin by discussing some limits of exploratory methods before presenting a non-technical overview of the Bayesian approach. References are provided for the technical details. A particular effort is made to illustrate the method with an example from psychology. References to software, more elaborate textbooks and tutorials enable researchers to apply this novel method to their own data.Peer reviewe
This paper focuses on two likelihood-based indices of person fit, the index lz (Drasgow, Levine &... more This paper focuses on two likelihood-based indices of person fit, the index lz (Drasgow, Levine & Williams, 1985) and the Snijders’ modified index lz* (Snijders, 2001). The first one is commonly used in practical assessment of person fit, although its asymptotic standard normal distribution is not valid when true abilities are replaced by sample ability estimates. The lz* index is a generalization of lz which corrects for this sampling variability. Surprisingly, it is not yet popular in the psychometric and educational assessment community. Moreover, there is some ambiguity about which type of item response model and ability estimation method can be used to compute the lz* index. The purpose of this paper is to present the index lz* in a simple and didactic approach. Starting from the relationship between lz and lz*, we develop the framework according to the type of logistic IRT model and the likelihood-based estimators of ability. The practical calculation of lz* is illustrated by ...
peer reviewedCette étude vise à examiner la présence de fonctionnement différentiel d’items selon... more peer reviewedCette étude vise à examiner la présence de fonctionnement différentiel d’items selon le sexe des répondants dans un test de compréhension en lecture en anglais administré à 171 universitaires francophones. Deux méthodes non paramétriques sont utilisées: le test Mantel-Haenszel et le modèle de régression logistique. Sur un total de 64 items, deux présentent un fonctionnement différentiel selon le test Mantel-Haenszel, alors que cinq items supplémentaires ressortent par la régression logistique. Ce faible nombre d’items suggère une bonne équité du test, mais les différences observées soulignent la nécessité d’analyses additionnelles pour clarifier le statut de ces items
Des mécanismes pour assurer la validité de l'interprétation de la mesure en éducation, 2011
Uploads
Papers by Sébastien Béland