A Comparison of the False Discovery Rate with Dunnett’s Test for a Large Number of Treatments
DOI:
https://doi.org/10.53555/nnms.v3i7.548Keywords:
ANOVA, multiple comparisons, family wise error rate, false discovery rateAbstract
Probabilities of two types of errors are estimated for the False Discovery Rate Procedure (FDR), Dunnett’s test, and conducting individual t-tests when treatments are being compared against a control. Probabilities for two types of powers are also estimated. The number of treatments considered is 50, 100, 150, and 300 with the first treatment being the control. Differing numbers of treatments equal to the control are considered with equal sample sizes of 3 and 5.
References
Montgomery, Douglas C. (1991). Design and Analysis of Experiments, Third Edition New York: John Wiley & Sons.
Benjamini Y., and Hochberg Y. (1995). Controlling the false discovery rate: A Practical and Powerful Approach to Multiple Testing. Journal of the Royal Statistical Society. Series B (Methodological), 57(1), 289-300.
Benjamini, Yoav. (2010). Discovering the false discovery rate. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 72(4), 405-416. doi: 10.1111/j.1467-9868.2010.00746.x
Osborne, Jason A. (2006). Estimating the False Discovery Rate using SAS. SAS Users Group International Proceedings, 190, 1-10
Benjamini Y., and Yekutieli D. (2001). The Control of the False Discovery Rate in Multiple Testing under Dependency. The Annals of Statistics, 29(4), 1165-1188.
Yekutieli, D. and Benjamini, Y. (1999). Resampling-based false discovery rate controlling multiple test procedures for correlated test statistics. Journal of Statistical Planning and Inference, 82, 171-196.
Benjamini Y., and Hochberg Y. (2000). On the Adaptive Control of the False Discovery Rate in Multiple Testing With Independent Statistics. Journal of Educational and Behavioral Statistics, 25(1 (Spring, 2000)), 60-83.
Storey, J.D. (2001). The positive False Discovery Rate: A Bayesian interpretation and the q-value. Annals of Statistics
Storey, J.D. (2002). A direct approach to false discovery rates. Journal of the Royal Statistical Society B, 64, 479-498.
Efron, Bradley. (2007). Size, Power And False Discovery Rates. The Annals of Statistics, 35(4), 1351-1377.
doi: 10.1214/009053606000001460
Benjamini, Yoav (2010). Discovering the false discovery rate. Journal of the Royal Statistical Society: Series B, 72(4), 405-416.
Gordon, Alexander, Glazko, Galina, Qiu, Xing, and Yakovlev, Andrei (2007). Contol of the mean number of false discoveries, Bonferroni and stability of multiple testing. Annals of Applied Statistics, 1(1), 179-190.
Dunnett, Charles W. (1955). A Multiple Comparison Procedure for Comparing Several Treatments with a Control. Journal of the American Statistical Association, 50(272), 1096-1121.
Dunnett, C. W. (1964). New Tables for Multiple Comparisons with a Control. Biometrics, 20(3), 482-491.
Hari Mukerjee, Tim Robertson and F. T. Wright. (1987). Comparison of Several Treatments with a Control Using Multiple Contrasts. Journal of the American Statistical Association, 82(399), 902-910.
SAS Institute Inc., (2011). SAS/STAT® 9.3 User’s Guide. Cary, NC: SAS Institute Inc.
Westfall, P. H. and Soper, K. A. (1994). Nonstandard Uses of PROC MULTTEST: Permutational Peto Tests; Permutational and Unconditional and Binomial Tests. Paper presented at the Proceedings of the Nineteenth Annual SAS Users Group International Conference, Cary, NC.
Westfall, P. H. and Wolfinger, R. D. . (2000). Closed Multiple Testing Procedures and PROC MULTTEST. Observations.
Westfall, P. H., Wolfinger, R. D. and Tobias, Randall D. . (2011). Multiple Comparisons and Multiple Tests Using SAS (Second ed.): SAS Institute.
Kubat, Jamie Marie. (2013). Comparing Dunnett's test with the false discovery rate method: A simulation study. (Masters), North Dakota State University.
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
You are free to:
- Share — copy and redistribute the material in any medium or format for any purpose, even commercially.
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
- The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms:
- Attribution — You must give appropriate credit , provide a link to the license, and indicate if changes were made . You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices:
You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation .
No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.
