Effects of Rating Task Instructions on Consistency and Accuracy of Expert Raters [microform] / John H. Littlefield and G. Roger Troendle
- Bib ID:
- 5487611
- Format:
- Book and Microform
- Author:
- Littlefield, John H
- Online Version:
- https://eric.ed.gov/?id=ED290795
Broken link? let us search Trove , the Wayback Machine , or Google for you.
- Description:
-
- [Washington, D.C.] : Distributed by ERIC Clearinghouse, 1987
- 9 p.
- Summary:
-
The effect of different types of rating task instructions on rater behavior was examined using experts, as opposed to novices, as raters. The experts were instructed to (1) form a global categorical judgment (early hypothesis generation); (2) assess 19 detailed elements; or (3) both. Subjects were 8 dental faculty members who ranged in age from 28 to 60 and who had at least 2 years of teaching experience. The task was to evaluate five three-fourth dental crown preparations twice, using each of the three types of rating instructions. Intrarater and interrater agreement and reliability were assessed, as was the level of rater accuracy. Higher coefficients of rater reliability, but not agreement, resulted from the global and combined instructions, compared with the 19-point, or traditional, instruction. The global judgment alone improved reliability over traditional instructions, but intrarater agreement was lower. Expert rater consistency was higher when early hypothesis generation and self-monitoring were encouraged by the rating instructions. There were no significant differences in score accuracy among the three types of instruction. (MGD)
- Notes:
-
- ERIC Note: Paper presented at the Annual Meeting of the American Educational Research Association (Washington, DC, April 20-24, 1987).
- May also be available online. Address as at 14/8/18: https://eric.ed.gov/
- Reproduction:
- Microfiche. [Washington D.C.]: ERIC Clearinghouse microfiches : positive.
- Subject:
- Other authors/contributors:
- Troendle, G. Roger, author
- Available From:
- ERIC
- Copyright:
-
In Copyright
You may copy under some circumstances, for example you may copy a portion for research or study. Order a copy through Copies Direct to the extent allowed under fair dealing. Contact us for further information about copying.
Copyright status was determined using the following information:
- Material type:
- Literary Dramatic Musical
- Published status:
- Published
- Publication date:
- 1987
Copyright status may not be correct if data in the record is incomplete or inaccurate. Other access conditions may also apply. For more information please see: Copyright in library collections.
Request this item
Request this item to view in the Library’s reading room.
Feedback
Similar items
- Full-scale engine demonstration of an advanced sensor failure detection, isolation, and accomodation algorithm [microform] : preliminary results / Walter C. Merrill ... [et al.]
- Reliability: management, methods, and mathematics / by D.K.Lloyd and Myron Lipow
- Fundamentals of reliability theory, by A. M. Polovko. Translated by Scripta Technica. Translation edited by William H. Pierce
- An overview of reliability growth models and their potential use for NASA applications [microform] / V.S. Taneja, F.M. Safie
- Guidance on planning and implementing computer system reliability [microform] / Lynne S. Rosenthal