National Library of Australia

<< Previous record  /  Next record >>
Record 161 of 240
You must be logged in to Tag Records
How Out-of-Level Testing Affects the Psychometric Quality of Test Scores. Out-of-Level Testing Report 2 [microform] / John Bielinski, Martha Thurlow and Jane Minnema
Bib ID 5677007
Format BookBook, MicroformMicroform, OnlineOnline
Bielinski, John
Online Versions
Description [Washington, D.C.] : Distributed by ERIC Clearinghouse, 2000 
29 p. 

This report is a review and analysis of the psychometric literature on the topic of out-of-level testing. Out-of-level testing refers to the practice of using a level of the test other than the test taken by most of the students in a student's current grade level. Much of the research on out-of-level testing was conducted in the 1970s and 1980s, and the emphasis on chance-level scoring of these studies has detracted from the understanding of how out-of-level testing actually works to affect score reliability. The studies said little about the important concept of measurement error, and there was little discussion about the detrimental effects of translating scores from an out-of-level test back into the scale of the in-level test. The literature indicates that the benefit of out-of-level testing is that it is a cost-effective method for increasing the precision with which low performing students' ability is measured. However, an unreported downside is that the process by which scores on out-of-level testing are converted back into the scale of the in-level test reduces measurement precision. This report focuses on how out-of-level testing affects test score quality. It emphasizes the links among test difficulty, individual ability, and measurement error and discusses the neglected topic of measurement error that is introduced by the equating process used to translate the out-of-level test scores onto the in-level scale. The dramatic increase in the use of out-of-level testing that appears to be taking place across the United States is certainly not justified by the findings of this analysis, and the application of an approach developed in a norm-referenced context seems inappropriate in the current context of standards-based assessments. (Contains 4 figures and 42 references.) (SLD)


Availability: National Center on Educational Outcomes, University of Minnesota, 350 Elliott Hall, 75 East River Road, Minneapolis, MN 55455 ($10). Tel: 612-624-8561; Fax: 612-624-0879; Web site:

Sponsoring Agency: Special Education Programs (ED/OSERS), Washington, DC.

Contract Number: H159C950004.

ERIC Note: In collaboration with the Council of Chief State School Officers and the National Association of State Directors of Special Education. For previous report see ED446409.

May also be available online. Address as at 14/8/18:

Reproduction Microfiche. [Washington D.C.]: ERIC Clearinghouse microfiches : positive. 
Subjects Achievement Tests.  |  Elementary Secondary Education.  |  Equated Scores.  |  Error of Measurement.  |  Literature Reviews.  |  Psychometrics.  |  Scores.  |  Standardized Tests.  |  Student Evaluation.  |  Test Format.  |  Test Use.  |  Out of Level Testing
Form/genre Information Analyses.
Other authors/contributors Thurlow, Martha, author  |  Minnema, Jane, author  |  Scott, Jim, author  |  National Center on Educational Outcomes, Minneapolis, MN
Available From ERIC 


In the Library

Request this item to view in the Library's reading rooms using your library card. To learn more about how to request items watch this short online video Help Video.

Details Collect From
mc 2253 ED449174 Main Reading Room - Newspapers and Family History
This item may be online. Please search the ERIC website prior to requesting this microfiche item.

Order a copy

- Copyright or permission restrictions may apply. We will contact you if necessary.

Help Video To learn more about Copies Direct watch this short online video Help Video.
close Can I borrow items from the Library?

You need Flash player 8+ and JavaScript enabled to view this video embedded.

You can view this on the NLA website.

close What can I get online?

You need Flash player 8+ and JavaScript enabled to view this video embedded.

You can view this on the NLA website.

close Can I get copies of items from the Library?

You need Flash player 8+ and JavaScript enabled to view this video embedded.

You can view this on the NLA website.

Aboriginal and Torres Strait Islander Flags
Aboriginal, Torres Strait Islander and other First Nations people are advised that this catalogue contains names, recordings and images of deceased people and other content that may be culturally sensitive. Please also be aware that you may see certain words or descriptions in this catalogue which reflect the author’s attitude or that of the period in which the item was created and may now be considered offensive.