February, 2003
© 2000, 2001  Scott S. Emerson, M.D., Ph.D.
Session 2: 40
Inadequacy of Fixed Sample Methods
The critical values can be varied across analyses
Level 0.10 O’Brien-Fleming (1979); equally spaced tests at .003, .036, .087
Pattern of                 Proportion Significant
Significance           1st      2nd      3rd      Ever
1st only             .00082                      .00082
1st, 2nd             .00036   .00036             .00036
1st, 3rd             .00037            .00037    .00037
1st, 2nd, 3rd        .00127   .00127   .00127    .00127
2nd only                      .01164             .01164
2nd, 3rd                      .02306   .02306    .02306
3rd only                               .06223    .01855
Any pattern          .00282   .03633   .08693    .09975