Using Generalizability Theory and Multifacet Designs in the Validation of a Classroom Observation Instrument [microform] / J. Philip Baker
- Bib ID:
- 5236763
- Format:
- Book and Microform
- Author:
- Baker, J. Philip
- Online Version:
- https://eric.ed.gov/?id=ED068534
Broken link? let us search Trove , the Wayback Machine , or Google for you.
- Description:
-
- [Washington, D.C.] : Distributed by ERIC Clearinghouse, 1971
- 17 p.
- Summary:
-
The usefulness of generalizability theory in assessing the reliability of classroom observation instruments is illustrated, with a new index of reliability, called the coefficient of generalizability, given as an index of how well one can generalize from the instrument to the universe score according to the conditions of observation. Data from an instrument assessing verbal behavior are reanalyzed using generalizability theory. Three raters observed two classes of five student teachers, and three facets (class, occasion, and rater) were specified for study. Analysis of variance yielded the components of variance due to these facets, and ratio of the estimated universe. Score variance to the observed-score variance was computed as the coefficient of generalizability. The possible effect of various hypothetical conditions of observation on the coefficient of generalizability was considered. The results showed the coefficient of generalizability for one rater observing one class on one day was near zero for most of the summary variables for the instrument, but it increased when the number of observers and days of observation were increased. This was directly attributable to rater bias. Different observer training procedures might improve the usefulness of the instrument. (Author/LH)
- Notes:
-
- Sponsoring Agency: Office of Education (DHEW), Washington, DC.
- Contract Number: OEC-6-10-078.
- May also be available online. Address as at 14/8/18: https://eric.ed.gov/
- Reproduction:
- Microfiche. [Washington D.C.]: ERIC Clearinghouse microfiches : positive.
- Subject:
- Other authors/contributors:
- Stanford Univ., CA. Stanford Center for Research and Development in Teaching
- Available From:
- ERIC
- Copyright:
-
In Copyright
You may copy under some circumstances, for example you may copy a portion for research or study. Order a copy through Copies Direct to the extent allowed under fair dealing. Contact us for further information about copying.
Copyright status was determined using the following information:
- Material type:
- Literary Dramatic Musical
- Published status:
- Published
- Publication date:
- 1971
Copyright status may not be correct if data in the record is incomplete or inaccurate. Other access conditions may also apply. For more information please see: Copyright in library collections.
Request this item
Request this item to view in the Library’s reading room.
Feedback
Similar items
- Mandated Evaluation of Educators [microform] : A Conference on California's Stull Act. (Stanford, California, October 12-14, 1972.) / N. L. Gage, Ed
- A Study of Confusability of Codes in Observational Measurement [microform] / Jane Stallings and Phillip A. Giesen
- Invalidity of a Current Method for Estimating Reliability [microform] / Susan K. Thrash and Andrew C. Porter
- A Generalized Anova Model for Estimating the Reliability of Categorical Judgments [microform] / John M. Enger and Douglas R. Whitney
- The Development of the Contextual Observation System [microform] / Jane A. Stallings