Protected versus Unprotected Multiple Comparison Procedures [microform] / J. Jackson Barnette and James E. McLean
- Bib ID:
- 5624155
- Format:
- Book and Microform
- Author:
- Barnette, J. Jackson
- Online Version:
- https://eric.ed.gov/?id=ED427044
Broken link? let us search Trove , the Wayback Machine , or Google for you.
- Description:
-
- [Washington D.C.] : Distributed by ERIC Clearinghouse, 1998
- 15 p.
- Summary:
-
Conventional wisdom suggests the omnibus F-test needs to be significant before conducting post-hoc pairwise multiple comparisons. However, there is little empirical evidence supporting this practice. Protected tests are conducted only after a significant omnibus F-test while unprotected tests are conducted without regard to the significance of the omnibus F-test. Monte Carlo methods were used to generate replications expected to provide 0.95 confidence intervals of +/- 0.001 around the nominal alphas of 0.10, 0.05, and 0.01 for 42 combinations of "n" (5, 10, 15, 20, 30, 60, and 100) and numbers of groups (3, 4, 5, 6, 8, and 10). Unprotected and protected tests were conducted using the Dunn-Bonferroni, Dunn-Sidak, Holm, and Tukey's Honestly Significant Differences (HSD) procedures. Means and standard deviations of observed per-experiment Type I errors rates and percentages of observed per-experiment Type I error falling below, within, and above the 0.95 confidence intervals were determined for total number of Type I errors. Differences in observed Type I errors for sample size and number of groups was minimal. However, there were differences in Type I error control among the four multiple comparison procedures and when the tests were conducted as protected or unprotected. The Dunn-Bonferroni had the best control of Type I error as an unprotected test with 96.0% of the observed Type I errors falling within the 0.95 confidence interval while 87.3% of the observed Type I errors fell below the 0.95 confidence interval when used as a protected test, thus being very conservative. As unprotected tests, the Dunn-Sidak and Holm tended to be liberal, but were conservative as protected tests. The HSD was liberal in both situations, but much more so as an unprotected test. These results, combined with the ease of using the Dunn-Bonferroni, suggest this method may provide the most accurate and easiest control of per-experiment Type I error when used in an unprotected mode. (Contains 4 tables and 13 references.) (Author/SLD)
- Notes:
-
- ERIC Note: Paper presented at the Annual Meeting of the Mid-South Educational Research Association (27th, New Orleans, LA, November 4-6, 1998).
- May also be available online. Address as at 14/8/18: https://eric.ed.gov/
- Reproduction:
- Microfiche. [Washington D.C.]: ERIC Clearinghouse microfiches : positive.
- Subject:
- Genre/Form:
- Other authors/contributors:
- McLean, James E, author
- Available From:
- ERIC
- Copyright:
-
In Copyright
You may copy under some circumstances, for example you may copy a portion for research or study. Order a copy through Copies Direct to the extent allowed under fair dealing. Contact us for further information about copying.
Copyright status was determined using the following information:
- Material type:
- Literary, dramatic or musical work
- Published status:
- Published
- Publication date:
- 1998
Copyright status may not be correct if data in the record is incomplete or inaccurate. Other access conditions may also apply. For more information please see: Copyright in library collections.
Request this item
Request this item to view in the Library’s reading room.
Similar items
- Die Wiederaufnahme des Strafverfahrens im deutschen und auslandischen Recht / hrsg. von Hans-Heinrich Jescheck u. Jurgen Meyer
- Sosho kankei to sosho koi / Nakano Teiichiro
- Early disposal of court cases : simplification of procedure, bottlenecks, role of bar and judiciary / V.K. Mathur
- Nieskolko lektsii po ugolovnomu protsessu / N.V. Davydova
- The accused : a comparative study / edited and with an introduction by J. A. Coutts