A Monte Carlo Investigation of the Contrasting Groups Standard Setting Method [microform] / Gregory J. Cizek and Timothy H. Husband
- Bib ID:
- 5606630
- Format:
- Book and Microform
- Author:
- Cizek, Gregory J
- Online Version:
- https://eric.ed.gov/?id=ED408342
Broken link? let us search Trove , the Wayback Machine , or Google for you.
- Description:
-
- [S.l.] : Distributed by ERIC Clearinghouse, 1997
- 34 p.
- Summary:
-
The contrasting groups method is one of many possible methods for setting passing scores. The most commonly used method is probably that developed by W. H. Angoff (1971), but it has been suggested that the Angoff method may not be appropriate for many standard setting applications in education. The contrasting groups method is explored as an alternative for educational research. To implement the contrasting groups method, experts are asked to make a dichotomous judgment about examinees, usually in the form of master/nonmaster, competent/not competent, certify/deny, and so on. All judged examines then take a test covering the content area of the domain of interest. This process results in two distributions of test scores, one for the group judged masters and one for the group judged nonmasters. These two distributions can be examined and used to derive a cutting score for the examination which is then applied to examinees who take the test for whom expert judgments of mastery are not available. In this study the contrasting groups graphing procedure was used in conjunction with various combinations of population and standard setting characteristics to examine the conditions under which it most reliably captures a known standard. A Monte Carlo approach was used to simulate and analyze populations with differing distributional forms, different percentages of master and nonmasters, various sample sizes, differing sampling strategies, and varying judge error rates. Overall, findings produced suggestions that the contrasting groups graphing procedure can be applied confidently to estimate a "true" cutting score in a variety of applications. Best sampling practices are discussed, and limitations of the expert criterion judgments are reviewed. (Contains 1 table, 8 figures, and 23 references.) (SLD)
- Notes:
-
- ERIC Note: Paper presented at the Annual Meeting of the American Educational Research Association (Chicago, IL, March 24-28, 1997).
- May also be available online. Address as at 14/8/18: https://eric.ed.gov/
- Reproduction:
- Microfiche. [Washington D.C.]: ERIC Clearinghouse microfiches : positive.
- Subject:
- Other authors/contributors:
- Husband, Timothy H, author
- Available From:
- ERIC
- Copyright:
-
In Copyright
You may copy under some circumstances, for example you may copy a portion for research or study. Order a copy through Copies Direct to the extent allowed under fair dealing. Contact us for further information about copying.
Copyright status was determined using the following information:
- Material type:
- Literary Dramatic Musical
- Published status:
- Published
- Publication date:
- 1997
Copyright status may not be correct if data in the record is incomplete or inaccurate. Other access conditions may also apply. For more information please see: Copyright in library collections.
Request this item
Request this item to view in the Library’s reading room.
Feedback
Similar items
- Counseling methods / edited by John D. Krumboltz, Carl E. Thoresen
- Methods and statistical needs for educational planning
- Controversies regarding the Nature of Score Validity [microform] : Still Crazy after All These Years / B. Thomas Gray
- Educational Games in Today's Learning [microform] / Roger A. Smith
- "Dial-Access" as an Instructional Medium [microform] / R. Stafford North