Validity Arguments for Diagnostic Assessment Using Automated Writing Evaluation

Thumbnail Image
Date
2015-01-01
Authors
Cotos, Elena
Lee, Jooyoung
Major Professor
Advisor
Committee Member
Journal Title
Journal ISSN
Volume Title
Publisher
Authors
Person
Chapelle, Carol
Distinguished Professor
Person
Cotos, Elena
Associate Dean
Research Projects
Organizational Units
Organizational Unit
English

The Department of English seeks to provide all university students with the skills of effective communication and critical thinking, as well as imparting knowledge of literature, creative writing, linguistics, speech and technical communication to students within and outside of the department.

History
The Department of English and Speech was formed in 1939 from the merger of the Department of English and the Department of Public Speaking. In 1971 its name changed to the Department of English.

Dates of Existence
1939-present

Historical Names

  • Department of English and Speech (1939-1971)

Related Units

Journal Issue
Is Version Of
Versions
Series
Department
English
Abstract

Two examples demonstrate an argument-based approach to validation of diagnostic assessment using automated writing evaluation (AWE). Criterion ®, was developed by Educational Testing Service to analyze students’ papers grammatically, providing sentence-level error feedback. An interpretive argument was developed for its use as part of the diagnostic assessment process in undergraduate university English for academic purposes (EAP) classes. The Intelligent Academic Discourse Evaluator (IADE) was developed for use in graduate EAP university classes, where the goal was to help students improve their discipline-specific writing. The validation for each was designed to support claims about the intended purposes of the assessments. We present the interpretive argument for each and show some of the data that have been gathered as backing for the respective validity arguments, which include the range of inferences that one would make in claiming validity of the interpretations, uses, and consequences of diagnostic AWE-based assessments.

Comments

This is a manuscript of an article from Language Testing 32 (2015): 385, doi: 10.1177/0265532214565386. Posted with permission.

Description
Keywords
Citation
DOI
Copyright
Thu Jan 01 00:00:00 UTC 2015
Collections