
John Duffy
I am a professor of English at the University of Notre Dame.
less
Related Authors
Ma Vang
University of California, Merced
Yang Sao Xiong
University of Wisconsin-Madison
Christin DePouw
NWTC
Ma Vang
University of California, Merced
InterestsView All (10)
Uploads
Papers by John Duffy
of three lines of work: the growing understanding of fairness, validity,
and reliability as both categories of evidence and ethical frameworks
(Kelly-Riley and Whithaus 2016); an ecological view of human cognition
as applied to writing (White, Elliot, and Peckham 2015); and a sociocognitive view of assessment as an expression of contextualized, purposive arguments (Mislevy 2018). Significantly, our model thus resonates with that of David Slomp’s (2016) framework for using consequential validity evidence in evaluating each step in writing assessment design. These lines of work inform the structure of our chapter and the model proposed in it. We first turn to an integrative perspective in which a defined view of psychometrics (identified as sociocognitive) is used to design a construct-driven approach to writing (identified as nomothetic). We then combine the desire to use situative perspectives with efforts to describe the span of the writing construct. We conclude with a summary of four ethical principles that are implicit in our model that, taken together, call for enhanced attention to construct validity and the integrative framework that is provided by evidence of fairness. In emphasizing this integrative approach, we believe researchers can structurally design assessments that, in context and use, are ethical in nature. With the reservation that conceptual models are limited in terms of their applications—as are all human endeavors intending to structure opportunities—we hold that ours bakes a certain kind of ethical perspective (identified with fairness) into the assessment itself.
of three lines of work: the growing understanding of fairness, validity,
and reliability as both categories of evidence and ethical frameworks
(Kelly-Riley and Whithaus 2016); an ecological view of human cognition
as applied to writing (White, Elliot, and Peckham 2015); and a sociocognitive view of assessment as an expression of contextualized, purposive arguments (Mislevy 2018). Significantly, our model thus resonates with that of David Slomp’s (2016) framework for using consequential validity evidence in evaluating each step in writing assessment design. These lines of work inform the structure of our chapter and the model proposed in it. We first turn to an integrative perspective in which a defined view of psychometrics (identified as sociocognitive) is used to design a construct-driven approach to writing (identified as nomothetic). We then combine the desire to use situative perspectives with efforts to describe the span of the writing construct. We conclude with a summary of four ethical principles that are implicit in our model that, taken together, call for enhanced attention to construct validity and the integrative framework that is provided by evidence of fairness. In emphasizing this integrative approach, we believe researchers can structurally design assessments that, in context and use, are ethical in nature. With the reservation that conceptual models are limited in terms of their applications—as are all human endeavors intending to structure opportunities—we hold that ours bakes a certain kind of ethical perspective (identified with fairness) into the assessment itself.