Problems in Stabilizing the Judgment Process [microform] / Edys Quellmalz
- Bib ID:
- 5414173
- Format:
- Book and Microform
- Author:
- Quellmalz, Edys
- Online Version:
- https://eric.ed.gov/?id=ED218317
Broken link? let us search Trove , the Wayback Machine , or Google for you.
- Description:
-
- [Washington, D.C.] : Distributed by ERIC Clearinghouse, 1980
- 27 p.
- Summary:
-
Measurement problems which jeopardize the reliability and validity of competency-based writing assessments are analyzed. Methods to stabilize rating criteria and readers' application of them are necessary. Most writing assessment programs use guidelines from norm-referenced test methodology. Use of this method of criteria application based on ranking within-occasion endangers or precludes between-occasion uniformity. Judgment stability within a session and across sessions are other problems of measurement. The instability of ratings has been a major weakness of writing skills measures. Two indicators of rating variability are discussed. Rater drift is the rater's progressive deviation within a scoring session from previously shared criteria. Scale instability is the differential application of criteria by raters in different scoring sessions. During scale development and validation, assessments should collect separate ratings on component text features that comprise a total score. Rating methods should intersperse periodic checks. Frequency of checks and nature of feedback on scoring accuracy are important. Sound writing assessment requires scale stability. (Author/DWH)
- Notes:
-
- Sponsoring Agency: National Inst. of Education (ED), Washington, DC.
- May also be available online. Address as at 14/8/18: https://eric.ed.gov/
- Reproduction:
- Microfiche. [Washington D.C.]: ERIC Clearinghouse microfiches : positive.
- Subject:
- Other authors/contributors:
- California Univ., Los Angeles. Center for the Study of Evaluation
- Available From:
- ERIC
- Copyright:
-
In Copyright
You may copy under some circumstances, for example you may copy a portion for research or study. Order a copy through Copies Direct to the extent allowed under fair dealing. Contact us for further information about copying.
Copyright status was determined using the following information:
- Material type:
- Literary Dramatic Musical
- Published status:
- Published
- Publication date:
- 1980
Copyright status may not be correct if data in the record is incomplete or inaccurate. Other access conditions may also apply. For more information please see: Copyright in library collections.
Request this item
Request this item to view in the Library’s reading room.