Extension of Guilford's Rating Adjustment Technique to Situations Where Not All Raters Rate All Ratees [microform] / Martin K. Chen
- Bib ID:
- 5218986
- Format:
- Book and Microform
- Author:
- Chen, Martin K
- Online Version:
- https://eric.ed.gov/?id=ED048346
Broken link? let us search Trove , the Wayback Machine , or Google for you.
- Description:
-
- [Washington, D.C.] : Distributed by ERIC Clearinghouse, 1971
- 13 p.
- Summary:
-
Generally, ratings have notoriously low inter-rater reliabilities. Because of differences in orientation, background, and expectations, ratings are seldom made from the same point of reference; thus, many types of error mask the true rating variance. Guilford's technique identified most types of constant error by analysis of variance and then eliminated by an adjustment technique. This, however, does not remove all possible errors; it only "cleans up" the ratings to the extent these known errors no longer contribute to the error variance. The technique, moreover, is not applicable where not all raters have ratings for all ratees on all traits. It is proposed that if the number of missing values is relatively small, one of several methods be used to estimate the missing data before an analysis of variance is performed. Depending on the validity of the statistical assumptions made in the estimation, these methods are capable of producing reasonable estimates for the missing data. Three possible methods are illustrated with data taken from Guilford's work. The accuracy of the methods is compared before performing the analysis of variance and making the required adjustments. Further, the inter-rater reliabilities of the adjusted data and of the unadjusted data are estimated, using the Spearman-Brown formula by analysis of variance. A comparison of the two reliability coefficients reflects the degree to which the adjustment has been useful. (Author)
- Notes:
-
- ERIC Note: Paper presented at the Annual Meeting of the American Educational Research Association, New York, New York, February 4-7, 1971.
- May also be available online. Address as at 14/8/18: https://eric.ed.gov/
- Reproduction:
- Microfiche. [Washington D.C.]: ERIC Clearinghouse microfiches : positive.
- Subject:
- Available From:
- ERIC
- Copyright:
-
In Copyright
You may copy under some circumstances, for example you may copy a portion for research or study. Order a copy through Copies Direct to the extent allowed under fair dealing. Contact us for further information about copying.
Copyright status was determined using the following information:
- Material type:
- Literary Dramatic Musical
- Published status:
- Published
- Publication date:
- 1971
Copyright status may not be correct if data in the record is incomplete or inaccurate. Other access conditions may also apply. For more information please see: Copyright in library collections.
Request this item
Request this item to view in the Library’s reading room.
Feedback
Similar items
- Saving all the bits [microform] / Peter J. Denning
- On the relationship of all bee-races, with suggestion for their improvement / by Rich. Helms
- Interpreting soil test results : what do all the numbers mean? / Pam Hazelton and Brian Murphy
- A theory for all music : problems and solutions in the analysis of non-Western forms / Jay Rahn
- Philosophy and language : an inaugural lecture delivered before the University of Oxford on 3 November 1960 / by A.J. Ayer