Access the full text.
Sign up today, get DeepDyve free for 14 days.
M. Blanca, J. Arnau, Dolores López-Montiel, Roser Bono, R. Bendayan (2013)
Skewness and Kurtosis in Real Data SamplesMethodology: European Journal of Research Methods for The Behavioral and Social Sciences, 9
T. Mathew (2001)
The Analysis of VarianceTechnometrics, 43
A. Tomarken, R. Serlin (1986)
QUANTITATIVE METHODS IN PSYCHOLOGY Comparison of ANOVA Alternatives Under Variance Heterogeneity and Specific Noncentrality Structures
H. Keselman, C. Huberty, L. Lix, Stephen Olejnik, R. Cribbie, Barbara Donahue, R. Kowalchuk, Laureen Lowman, Martha Petoskey, J. Keselman, J. Levin (1998)
Statistical Practices of Educational Researchers: An Analysis of their ANOVA, MANOVA, and ANCOVA AnalysesReview of Educational Research, 68
G. Box (1953)
NON-NORMALITY AND TESTS ON VARIANCESBiometrika, 40
P. Hsu (1938)
Contribution to the theory of "Student's" t-test as applied to the problem of two samples.
S. Maxwell, H. Delaney (1990)
Designing Experiments and Analyzing Data: A Model Comparison Perspective
E. Brunner, H. Dette, A. Munk (1997)
Box-Type Approximations in Nonparametric Factorial DesignsJournal of the American Statistical Association, 92
Richard Kohr, P. Games (1974)
Robustness of the Analysis of Variance, the Welch Procedure and a Box Procedure to Heterogeneous VariancesJournal of Experimental Education, 43
(1992)
Type I error and the number of iterations inMonte Carlo studies of robustness
K. Moder (2010)
Alternatives to F-Test in One Way ANOVA in case of heterogeneity of variances (a simulation study)
L. Lix, H. Keselman (1998)
To Trim or Not to Trim: Tests of Location Equality Under Heteroscedasticityand NonnormalityEducational and Psychological Measurement, 58
R. Grissom (2000)
Heterogeneity of variance in clinical data.Journal of consulting and clinical psychology, 68 1
E. Russek, W. Hays (1982)
Statistics (3rd ed.).Journal of the American Statistical Association, 77
W. Mickelson (2013)
A Monte Carlo Simulation of the Robust Rank-Order Test Under Various Population Symmetry ConditionsJournal of Modern Applied Statistical Methods, 12
(2002)
Fermat , Shubert , Einstein , and Behrens - Fisher : The probable difference between two means when σ 1 2 ≠ σ 22
K. Moder (2016)
How to keep the Type I Error Rate in ANOVA if Variances are HeteroscedasticAustrian Journal of Statistics, 36
Susan Skidmore, B. Thompson (2010)
Statistical Techniques Used in Published Articles: A Historical Review of ReviewsEducational and Psychological Measurement, 70
A. Bryk, S. Raudenbush (1988)
Heterogeneity of Variance in Experimental Studies: A Challenge to Conventional InterpretationsPsychological Bulletin, 104
R. Wilcox, Ventura in, Karen Thompson (1986)
New monte carlo results on the robustness of the anova f, w and f statisticsCommunications in Statistics - Simulation and Computation, 15
BG Tabachnick, LS Fidell (2007)
Experimental design using ANOVA
Michael Weisberg (2006)
Robustness AnalysisPhilosophy of Science, 73
(2012)
Robust means modeling : An alternative for hypothesis testing of independent means under variance heterogeneity and nonnormality
Shun-Yi Chen, Hubert Chen (1998)
Single-stage analysis of variance under heteroscedasticityCommunications in Statistics - Simulation and Computation, 27
W. Cochran (1941)
The distribution of the largest of a set of estimated variances as a fraction of their totalAnnals of Human Genetics, 11
K. Kieffer, R. Reese, B. Thompson (2001)
Statistical Techniques Employed in AERJ and JCP Articles from 1988 to 1997: A Methodological ReviewThe Journal of Experimental Education, 69
H. Keselman, J. Algina, R. Kowalchuk, R. Wolfinger (1999)
A comparison of recent approaches to the analysis of repeated measurementsBritish Journal of Mathematical and Statistical Psychology, 52
R. Young (1980)
Introduction to design and analysis: A student's handbook.Psyccritiques, 25
Morton Brown, A. Forsythe (1974)
The Small Sample Behavior of Some Statistics Which Test the Equality of Several MeansTechnometrics, 16
(2013)
SAS® 9.4 guide to software Updates
B. Tabachnick, L. Fidell (2007)
Using multivariate statistics, 5th ed.
R. Bendayan, Jaime Arnau, M. Blanca, Roser Bono (2014)
Comparison of the procedures of Fleishman and Ramberg et al. for generating non-normal data in simulation studiesAnales De Psicologia, 30
Alessandra Mattei, F. Mealli, A. Nodehi (2006)
Design and Analysis of ExperimentsTechnometrics, 48
R. Wilcox, H. Keselman, R. Kowalchuk (1998)
Can tests for treatment group equality be improved?: The bootstrap and trimmed means conjectureBritish Journal of Mathematical and Statistical Psychology, 51
Michael Harwell, E. Rubinstein, W. Hayes, C. Olds (1992)
Summarizing Monte Carlo Results in Methodological Research: The One- and Two-Factor Fixed Effects ANOVA CasesJournal of Educational Statistics, 17
G. Box (1954)
Some Theorems on Quadratic Forms Applied in the Study of Analysis of Variance Problems, I. Effect of Inequality of Variance in the One-Way ClassificationAnnals of Mathematical Statistics, 25
H Levene (1960)
Contributions to probability and statistics
David Erceg-Hurn, Vikki Mirosevich (2008)
Modern robust statistical methods: an easy way to maximize the accuracy and power of your research.The American psychologist, 63 7
D. Adler (2016)
Using Multivariate Statistics
E. Yigit, F. Gökpınar (2010)
A SIMULATION STUDY ON TESTS FOR ONE-WAY ANOVA UNDER THE UNEQUAL VARIANCE ASSUMPTION, 59
S. Sawilowsky, R. Blair (1992)
A more realistic look at the robustness and Type II error properties of the t test to departures from population normality.Psychological Bulletin, 111
R. Bailey (2005)
Designing Experiments and Analyzing Data: a Model Comparison Perspective, 2nd ednJournal of The Royal Statistical Society Series A-statistics in Society, 168
H. Hartley (1950)
The use of range in analysis of variance.Biometrika, 37 3-4
A. Kurtz, Samuel Mayo (1979)
Statistical methods in education and psychologyJournal of the American Statistical Association, 75
M. Mendeş, A. Pala (2004)
Evaluation of Four Tests When Normality and Homogeneity of Variance Assumptions are ViolatedJournal of Applied Sciences, 4
JC Rogan, HJ Keselman, LJ Breen (1977)
Assumption violations and rates of Type I error for the Tukey multiple comparison test: A review and empirical investigation via a coefficient of variance variationJournal of Experimental Education, 46
BJ Winer, DR Brown, KM Michels (1991)
Statistical principles in experimental design
R. Wilcox (1995)
ANOVA: The practical importance of heteroscedastic methods, using trimmed means versus means, and designing simulation studiesBritish Journal of Mathematical and Statistical Psychology, 48
(1952)
An empirical investigation of the effects of nonnormality and heterogeneity upon the F-test of analysis
AJ Tomarken, RC Serling (1986)
Comparison of ANOVA alternatives under variance heterogeneity and specific noncentrality structuresPsychological Bulletin, 99
K. Krishnamoorthy, Fei Lu, T. Mathew (2007)
A parametric bootstrap approach for ANOVA with unequal variances: Fixed and random modelsComput. Stat. Data Anal., 51
W. Conover, Mark Johnson, Myrle Johnson (1981)
A Comparative Study of Tests for Homogeneity of Variances, with Applications to the Outer Continental Shelf Bidding DataTechnometrics, 23
JV Bradley (1978)
Robustness?British Journal of Mathematical and Statistical Psychology, 31
R. Kowalchuk, H. Keselman, J. Algina, R. Wolfinger (2004)
The Analysis of Repeated Measurements with Mixed-Model Adjusted F TestsEducational and Psychological Measurement, 64
D. Sharma, B. Kibria (2013)
On some test statistics for testing homogeneity of variances: a comparative studyJournal of Statistical Computation and Simulation, 83
Xinmin Li, Juan Wang, Hua Liang (2011)
Comparison of several means: A fiducial based approachComput. Stat. Data Anal., 55
R. Cribbie, R. Wilcox, Carmen Bewell, H. Keselman (2007)
Tests for Treatment Group Equality When Data are Nonnormal and HeteroscedasticJournal of Modern Applied Statistical Methods, 6
I. Parra-Frutos (2014)
Controlling the Type I error rate by using the nonparametric bootstrap when comparing means.The British journal of mathematical and statistical psychology, 67 1
W. Zijlstra (2004)
Comparing the Student ' s t and the ANOVA contrast procedure with five alternative procedures
A. Burton, D. Altman, P. Royston, R. Holder (2006)
The design of simulation studies in medical statisticsStatistics in Medicine, 25
R. Grissom, John Kim (2001)
Review of assumptions and problems in the appropriate conceptualization of effect size.Psychological methods, 6 2
J. Clinch, H. Keselman (1982)
Parametric Alternatives to the Analysis of VarianceJournal of Educational Statistics, 7
John Ruscio, B. Roche (2012)
Variance Heterogeneity in Published Psychological Research A Review and a New Index
B. Bhat, M. Badade, K. Rao (2002)
A NEW TEST FOR EQUALITY OF VARIANCES FOR k NORMAL POPULATIONSCommunications in Statistics - Simulation and Computation, 31
Jacques Noyé (1993)
To Trim or Not to Trim?
Sunho Lee, Chul Ahn (2003)
Modified ANOVA for Unequal VariancesCommunications in Statistics - Simulation and Computation, 32
L. Lix, J. Keselman, H. Keselman (1996)
Consequences of Assumption Violations Revisited: A Quantitative Review of Alternatives to the One-Way Analysis of Variance F TestReview of Educational Research, 66
Yoonjeong Kang, Jeffrey Harring, Ming Li (2015)
Reexamining the Impact of Nonnormality in Two-Group Comparison ProceduresThe Journal of Experimental Education, 83
Xinwei Deng (2012)
Experimental designWiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 2
Joanne Rogan, H. Keselman (1977)
Is the ANOVA F-Test Robust to Variance Heterogeneity When Sample Sizes are Equal?: An Investigation via a Coefficient of VariationAmerican Educational Research Journal, 14
M. Bartlett (1992)
Properties of Sufficiency and Statistical TestsProceedings of The Royal Society A: Mathematical, Physical and Engineering Sciences, 160
G. Glass, P. Peckham, J. Sanders (1972)
Consequences of Failure to Meet Assumptions Underlying the Fixed Effects Analyses of Variance and CovarianceReview of Educational Research, 42
D. Zimmerman (2004)
A note on preliminary tests of equality of variances.The British journal of mathematical and statistical psychology, 57 Pt 1
(2007)
Simulations to analyze Type I error and power in the ANOVA F test and nonparametric alternatives (Master’s
H. Büning (1997)
Robust analysis of varianceJournal of Applied Statistics, 24
Caroline Golinski, R. Cribbie (2009)
The expanding role of quantitative methodologists in advancing psychology.Canadian Psychology, 50
R. Cribbie, L. Fiksenbaum, H. Keselman, R. Wilcox (2012)
Effect of non-normality on test statistics for one-way independent groups designs.The British journal of mathematical and statistical psychology, 65 1
F. David, N. Johnson (1951)
The effect of non-normality on the power function of the F-test in the analysis of variance.Biometrika, 38 1-2
Joanne Rogan, H. Keselman, L. Breen (1977)
Assumption Violations and Rates of Type I Error for the Tukey Multiple Comparison TestJournal of Experimental Education, 46
J. Morgan (2005)
Design and Analysis: A Researcher's HandbookTechnometrics, 47
W. Kruskal, W. Wallis (1952)
Use of Ranks in One-Criterion Variance AnalysisJournal of the American Statistical Association, 47
G. Keppel, W. Saufley, H. Tokunaga (1980)
Introduction to Design and Analysis : A Student's Handbook
G. James (1951)
THE COMPARISON OF SEVERAL GROUPS OF OBSERVATIONS WHEN THE RATIOS OF THE POPULATION VARIANCES ARE UNKNOWNBiometrika, 38
T. Micceri (1989)
The unicorn, the normal curve, and other improbable creatures.Psychological Bulletin, 105
B. Welch (1951)
ON THE COMPARISON OF SEVERAL MEAN VALUES: AN ALTERNATIVE APPROACHBiometrika, 38
Jinadasa Gamage, Sam Weerahandi (1998)
Size performance of some tests in one-way anovaCommunications in Statistics - Simulation and Computation, 27
R. Alexander, D. Govern (1994)
A New and Simpler Approximation for ANOVA Under Variance HeterogeneityJournal of Educational Statistics, 19
Sam Weerahandi (1995)
ANOVA under Unequal Error VariancesBiometrics, 51
A. Ehrenberg, E. Lindquist (1953)
Design and analysis of experiments in psychology and education
R. Wilcox (1987)
New designs in analysis of variance.Annual Review of Psychology, 38
H. Levene (1961)
Robust tests for equality of variances
伏木 忠義, 駒木 文保, 合原 一幸 (2002)
Parametric bootstrap を用いた予測
G. Horsnell (1953)
THE EFFECT OF UNEQUAL GROUP VARIANCES ON THE F-TEST FOR THE HOMOGENEITY OF GROUP MEANSBiometrika, 40
RE Kirk (2013)
Experimental design. Procedures for the behavioral sciences
WL Hays (1981)
Statistics
Inconsistencies in the research findings on F-test robustness to variance heterogeneity could be related to the lack of a standard criterion to assess robustness or to the different measures used to quantify heterogeneity. In the present paper we use Monte Carlo simulation to systematically examine the Type I error rate of F-test under heterogeneity. One-way, balanced, and unbalanced designs with monotonic patterns of variance were considered. Variance ratio (VR) was used as a measure of heterogeneity (1.5, 1.6, 1.7, 1.8, 2, 3, 5, and 9), the coefficient of sample size variation as a measure of inequality between group sizes (0.16, 0.33, and 0.50), and the correlation between variance and group size as an indicator of the pairing between them (1, .50, 0, −.50, and −1). Overall, the results suggest that in terms of Type I error a VR above 1.5 may be established as a rule of thumb for considering a potential threat to F-test robustness under heterogeneity with unequal sample sizes.
Behavior Research Methods – Springer Journals
Published: Jun 22, 2017
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.