Quantitative Comparisons of Difficulty, Discrimination and Reliability of Machine-Scored Completion Items and Tests (in the MDT Un-Cued Answer-Bank Format) in Contrast with Statistics from Comparable Multiple Choice Questions [microform] : The First Round of Results / Paul S. Anderson and Albert D. Hyers
- Bib ID:
- 5549858
- Format:
- Book and Microform
- Author:
- Anderson, Paul S
- Online Version:
- https://eric.ed.gov/?id=ED349319
Broken link? let us search Trove , the Wayback Machine , or Google for you.
- Description:
-
- [Washington, D.C.] : Distributed by ERIC Clearinghouse, 1991
- 29 p.
- Summary:
-
Three descriptive statistics (difficulty, discrimination, and reliability) of multiple-choice (MC) test items were compared to those of a new (1980s) format of machine-scored questions. The new method, answer-bank multi-digit testing (MDT), uses alphabetized lists of up to 1,000 alternatives and approximates the completion style of assessment items. Five data sets were analyzed with a total of over 500 postsecondary students. Each student answered between 13 and 30 pairs (total of 110 pairs) of identical questions in both MC and MDT formats. Quantitative measures, including correlation and significance of difference in means, reveal that in comparison to MC questions, the MDT items predictably are: (1) more difficult; (2) consistently better discriminators (higher validity); and (3) continually better providers of test reliability. The evidence firmly indicates that the MDT answer bank format of responses is superior in these quantitative measures to the MC format for questions where either could be used appropriately. The MDT format could be widely used in education to improve measurement without raising costs. One table and four appendixes are included. Appendixes 1 and 2 provide background material and a description of the data sets. Appendixes 3 and 4 contain 15 tables of statistics describing the data sets. (Author/SLD)
- Notes:
-
- ERIC Note: Paper presented at the Annual Meeting of the National Council on Measurement in Education (Chicago, IL, April 4-6, 1991).
- May also be available online. Address as at 14/8/18: https://eric.ed.gov/
- Reproduction:
- Microfiche. [Washington D.C.]: ERIC Clearinghouse microfiches : positive.
- Subject:
- Other authors/contributors:
- Hyers, Albert D, author
- Available From:
- ERIC
- Copyright:
-
In Copyright
You may copy under some circumstances, for example you may copy a portion for research or study. Order a copy through Copies Direct to the extent allowed under fair dealing. Contact us for further information about copying.
Copyright status was determined using the following information:
- Material type:
- Literary Dramatic Musical
- Published status:
- Published
- Publication date:
- 1991
Copyright status may not be correct if data in the record is incomplete or inaccurate. Other access conditions may also apply. For more information please see: Copyright in library collections.
Request this item
Request this item to view in the Library’s reading room.
Feedback
Similar items
- Technical report on comparability and reliability of scores on uses and U.S. civil service commission typing tests [microform]
- Guidelines for Objective Testing of Students [microform] / Gerald J. Cason
- Dear Mama: Why Don't They Love Me Anymore? [microform] : NCME Measurement in Education, Vol. 6, No. 4, Fall 1975 / Thomas J. Fitzgibbon
- Selecting an Achievement Test [microform] : Principles and Procedures / Martin Katz
- Building Better English Tests [microform] : A Guide for Teachers of English in the Secondary School / Robert B. Carruthers