Sources of Variability in the Angoff Standard-Setting Process [microform] / Glennelle Halpin and James E. McLean
- Bib ID:
- 5539474
- Format:
- Book and Microform
- Author:
- Halpin, Glennelle
- Online Version:
- https://eric.ed.gov/?id=ED340737
Broken link? let us search Trove , the Wayback Machine , or Google for you.
- Description:
-
- [Washington, D.C.] : Distributed by ERIC Clearinghouse, 1991
- 16 p.
- Summary:
-
Although the standard-setting method of W. H. Angoff (1971) has broad-based support in the research literature, inconsistencies in the resulting standards do occur. Sources of these inconsistencies are examined in a study of judges, competencies (items), rounds (replications), and the interactions among them. A modified Angoff approach was used to set standards on the Alabama High School Graduation Examination (AHSGE), Second Edition. Thirty-four subject matter high school teachers (judges) convened to set standards for the AHSGE. Data from round-two estimates if made, or round-one estimates otherwise, were analyzed using three-way factorial analysis of variance, with judges, rounds, and competencies as independent variables. The analysis was repeated for reading, language, and mathematics. For language and mathematics, judges accounted for the largest amount of variability. For reading, competencies were the largest source of variability. Although variability was the focus, the high degree of agreement found is noted, lending credence to the standards set despite some variability. Three tables present study data, and a 15-item list of references is included. (SLD)
- Notes:
-
- ERIC Note: Paper presented at the Annual Meeting of the Mid-South Educational Research Association (20th, Lexington, KY, November 12-15, 1991).
- Educational level discussed: High Schools.
- May also be available online. Address as at 14/8/18: https://eric.ed.gov/
- Reproduction:
- Microfiche. [Washington D.C.]: ERIC Clearinghouse microfiches : positive.
- Subject:
-
- Analysis of Variance
- Error of Measurement
- Evaluators
- High Schools
- Interrater Reliability
- Language Tests
- Mathematics Tests
- Reading Tests
- Scoring
- Secondary School Teachers
- Standard Setting (Scoring)
- Test Reliability
- Testing Problems
- Angoff Methods
- Alabama High School Graduation Examination Variability Measurement
- Other authors/contributors:
- McLean, James E, author
- Available From:
- ERIC
- Copyright:
-
In Copyright
You may copy under some circumstances, for example you may copy a portion for research or study. Order a copy through Copies Direct to the extent allowed under fair dealing. Contact us for further information about copying.
Copyright status was determined using the following information:
- Material type:
- Literary Dramatic Musical
- Published status:
- Published
- Publication date:
- 1991
Copyright status may not be correct if data in the record is incomplete or inaccurate. Other access conditions may also apply. For more information please see: Copyright in library collections.
Request this item
Request this item to view in the Library’s reading room.
Feedback
Similar items
- Elimination vs. Best Answer Response Modes for M-C Tests [microform] / LeVerne S. Collet
- Reliability, Predictive Validity, and Personality Bias of Confidence-Weighted Scores [microform] / Andrew Ahlgren
- A Validation of the Smith Test for Measuring Teacher Judgment of Written Composition [microform] / Thomas E. Whalen
- An Assessment of the Kuder-Richardson Formula (20) Reliability Estimate for Moderately Speeded Tests [microform] / Frances Swineford
- A Review of Scoring Algorithms for Ability and Aptitude Tests [microform] / Shirley A. Chevalier