References
Agresti, Alan. 1980. “Generalized Odds Ratios for Ordinal
Data.” Biometrics, 59–67.
Algina, James, and H. J. Keselman. 2003. “Approximate Confidence
Intervals for Effect Sizes.” Educational and Psychological
Measurement 63 (4): 537–53. https://doi.org/10.1177/0013164403256358.
Anvari, Farid, and Daniël Lakens. 2021. “Using Anchor-Based
Methods to Determine the Smallest Effect Size of Interest.”
Journal of Experimental Social Psychology 96: 104159.
APA. 2010. Publication Manual of the American Psychological
Association. American Psychological Association. https://thuvienso.hoasen.edu.vn/handle/123456789/8327.
Baayen, R Harald, Douglas J Davidson, and Douglas M Bates. 2008.
“Mixed-Effects Modeling with Crossed Random Effects for Subjects
and Items.” Journal of Memory and Language 59 (4):
390–412.
Baguley, Thom. 2009. “Standardized or Simple Effect Size: What
Should Be Reported?” British Journal of Psychology 100
(3): 603–17.
Barr, Dale J, Roger Levy, Christoph Scheepers, and Harry J Tily. 2013.
“Random Effects Structure for Confirmatory Hypothesis Testing:
Keep It Maximal.” Journal of Memory and Language 68 (3):
255–78.
Bartoń, Kamil. 2023. MuMIn: Multi-Model Inference. https://CRAN.R-project.org/package=MuMIn.
Beck, Edward C., Anirudh K. Gowd, Joseph N. Liu, Brian R. Waterman,
Kristen F. Nicholson, Brian Forsythe, Adam B. Yanke, Brian J. Cole, and
Nikhil N. Verma. 2020. “How Is Maximum Outcome Improvement Defined
in Patients Undergoing Shoulder Arthroscopy for Rotator Cuff Repair? A
1-Year Follow-up Study.” Arthroscopy: The Journal of
Arthroscopic & Related Surgery 36 (7): 1805–10. https://doi.org/10.1016/j.arthro.2020.02.047.
Becker, Betsy J. 1988. “Synthesizing Standardized Mean-Change
Measures - UConn Library.” British Journal of Mathematical
and Statistical Psychology 41 (2): 257278. https://doi.org/https://doi.org/10.1111/j.2044-8317.1988.tb00901.x.
Ben-Shachar, Mattan S., Daniel Lüdecke, and Dominique Makowski. 2020.
“effectsize: Estimation of Effect Size
Indices and Standardized Parameters.” Journal of Open Source
Software 5 (56): 2815. https://doi.org/10.21105/joss.02815.
Ben-Shachar, Mattan S., Indrajeet Patil, Rémi Thériault, Brenton M.
Wiernik, and Daniel Lüdecke. 2023. “Phi, Fei, Fo, Fum: Effect
Sizes for Categorical Data That Use the Chi-Squared Statistic.”
Mathematics 11 (9): 1982. https://doi.org/10.3390/math11091982.
Blair, Graeme, Jasper Cooper, Alexander Coppock, and Macartan Humphreys.
2019. “Declaring and Diagnosing Research Designs.”
American Political Science Review 113: 838–59. https://declaredesign.org/paper.pdf.
Bonini, Matteo, Marcello Di Paolo, Diego Bagnasco, Ilaria Baiardini,
Fulvio Braido, Marco Caminati, Elisiana Carpagnano, et al. 2020.
“Minimal Clinically Important Difference for Asthma Endpoints: An
Expert Consensus Report.” European Respiratory Review 29
(156).
Bosco, Frank A., Herman Aguinis, Kulraj Singh, James G. Field, and
Charles A. Pierce. 2015. “Correlational Effect Size
Benchmarks.” Journal of Applied Psychology 100 (2):
431–49. https://doi.org/10.1037/a0038047.
Brunner, Edgar, and Ullrich Munzel. 2000. “The Nonparametric
Behrens-Fisher Problem: Asymptotic Theory and a Small-Sample
Approximation.” Biometrical Journal 42 (1): 17–25. https://doi.org/10.1002/(SICI)1521-4036(200001)42:1<17::AID-BIMJ17>3.0.CO;2-U.
Buchanan, Erin M., Amber Gillenwaters, John E. Scofield, and K. D.
Valentine. 2019. MOTE: Measure of the
Effect: Package to Assist in Effect Size Calculations and Their
Confidence Intervals. http://github.com/doomlab/MOTE.
Caldwell, Aaron R. 2022. “Exploring Equivalence Testing with the
Updated TOSTER r Package.” PsyArXiv. https://doi.org/10.31234/osf.io/ty8de.
Cliff, Norman. 1993. “Dominance Statistics: Ordinal Analyses to
Answer Ordinal Questions.” Psychological Bulletin 114
(3): 494.
Coe, R. 2012. “It’s the Effect Size, Stupid What Effect Size Is
and Why It Is Important.” In. https://www.semanticscholar.org/paper/It%27s-the-Effect-Size%2C-Stupid-What-effect-size-is-it-Coe/c5ac87df5d6e0e6b6de2f745284835c2a368b0f7.
Cohen, Jacob. 1988. Statistical Power Analysis for the Behavioral
Sciences. Academic Press.
Dahlke, Jeffrey A., and Brenton M. Wiernik. 2019. “psychmeta: An r Package for Psychometric
Meta-Analysis.” Applied Psychological Measurement 43
(5): 415–16. https://doi.org/10.1177/0146621618795933.
Daste, Camille, Hendy Abdoul, Frantz Foissac, Marie-Martine
Lefèvre-Colau, Serge Poiraudeau, François Rannou, and Christelle Nguyen.
2022. “Patient Acceptable Symptom State for Patient-Reported
Outcomes in People with Non-Specific Chronic Low Back Pain.”
Annals of Physical and Rehabilitation Medicine 65 (1): 101451.
https://doi.org/10.1016/j.rehab.2020.10.005.
Divine, George W, H James Norton, Anna E Barón, and Elizabeth
Juarez-Colunga. 2018. “The Wilcoxon–Mann–Whitney Procedure Fails
as a Test of Medians.” The American Statistician 72 (3):
278–86.
Faul, Franz, Edgar Erdfelder, Axel Buchner, and Albert-Georg Lang. 2009.
“Statistical Power Analyses Using G*Power 3.1: Tests for
Correlation and Regression Analyses.” Behavior Research
Methods 41 (4): 1149–60. https://doi.org/10.3758/BRM.41.4.1149.
Fritz, Catherine O., Peter E. Morris, and Jennifer J. Richler. 2012.
“Effect Size Estimates: Current Use, Calculations, and
Interpretation.” Journal of Experimental Psychology:
General 141 (1): 2–18. https://doi.org/10.1037/a0024338.
Funder, David C., and Daniel J. Ozer. 2019. “Evaluating Effect
Size in Psychological Research: Sense and Nonsense.” Advances
in Methods and Practices in Psychological Science 2 (2): 156–68. https://doi.org/10.1177/2515245919847202.
Gelman, Andrew. 2011. “Why It Doesn’t Make Sense in
General to Form Confidence Intervals by Inverting Hypothesis Tests |
Statistical Modeling, Causal Inference, and Social Science.” https://statmodeling.stat.columbia.edu/2011/08/25/why_it_doesnt_m/.
Gignac, Gilles E., and Eva T. Szodorai. 2016. “Effect Size
Guidelines for Individual Differences Researchers.”
Personality and Individual Differences 102 (November): 74–78.
https://doi.org/10.1016/j.paid.2016.06.069.
Glass, Gene V. 1981. “Meta-Analysis in Social Research.”
(No Title). https://cir.nii.ac.jp/crid/1130000795088566912.
Glass, Gene V., Barry McGaw, and Mary L. Smith. 1981.
“Meta-Analysis in Social Research.” (No Title). https://cir.nii.ac.jp/crid/1130000795088566912.
Guilford, J. P. 1965. “The Minimal Phi Coefficient and the Maximal
Phi.” Educational and Psychological Measurement 25 (1):
3–8. https://doi.org/10.1177/001316446502500101.
Harrell, Frank. 2020. “Author Checklist - Data Analysis.”
https://discourse.datamethods.org/t/author-checklist/3407.
Hedges, Larry V. 1981. “Distribution Theory for Glass’s Estimator
of Effect Size and Related Estimators.” Journal of
Educational Statistics 6 (2): 107–28. https://doi.org/10.3102/10769986006002107.
HEIJDE, DÉSIRÉE van der, MARISSA Lassere, JOHN Edmonds, JOHN Kirwan,
VIBEKE Strand, and Maarten Boers. 2001. “Minimal Clinically
Important Difference in Plain Films in RA: Group Discussions,
Conclusions, and Recommendations. OMERACT Imaging Task Force.”
The Journal of Rheumatology 28 (4): 914–17.
Hoekstra, Rink, Richard D. Morey, Jeffrey N. Rouder, and Eric-Jan
Wagenmakers. 2014. “Robust Misinterpretation of Confidence
Intervals.” Psychonomic Bulletin & Review 21 (5):
1157–64. https://doi.org/10.3758/s13423-013-0572-3.
Horst, Allison Marie, Alison Presmanes Hill, and Kristen B Gorman. 2020.
Palmerpenguins: Palmer Archipelago (Antarctica) Penguin Data.
https://doi.org/10.5281/zenodo.3960218.
Hunter, John E., and Frank L. Schmidt. 1990. Methods of
meta-analysis: correcting error and bias in research findings.
Newbury Park: Sage Publications.
Jané, Matthew B. 2023. Artifact Corrections for Effect Sizes:
Implementation in r and Application to Meta-Analysis. (n.p.). https://matthewbjane.quarto.pub/artifact-corrections-for-effect-sizes/.
Karch, Julian D. 2021. “Psychologists Should Use Brunner-Munzel’s
Instead of Mann-Whitney’s u Test as the Default Nonparametric
Procedure.” Advances in Methods and Practices in
Psychological Science 4 (2): 2515245921999602.
Kassambara, Alboukadel. 2019. Datarium: Data Bank for Statistical
Analysis and Visualization. https://CRAN.R-project.org/package=datarium.
Kelley, Ken. 2022. MBESS: The MBESS r Package. https://CRAN.R-project.org/package=MBESS.
Kelley, Ken, and Kristopher J. Preacher. 2012. “On Effect
Size.” Psychological Methods 17 (2): 137–52. https://doi.org/10.1037/a0028086.
Kirby, Kris N, and Daniel Gerlanc. 2013. “BootES: An r Package for
Bootstrap Confidence Intervals on Effect Sizes.” Behavior
Research Methods 45: 905–27.
Lakens, Daniël. 2013. “Calculating and Reporting Effect Sizes to
Facilitate Cumulative Science: A Practical Primer for t-Tests and
ANOVAs.” Frontiers in Psychology 4. https://www.frontiersin.org/articles/10.3389/fpsyg.2013.00863.
———. 2014. “The 20.” http://daniellakens.blogspot.com/2014/06/calculating-confidence-intervals-for.html.
———. 2022. “Sample Size Justification.” Collabra:
Psychology 8 (1): 33267. https://doi.org/10.1525/collabra.33267.
Lakens, Daniël, Anne M Scheel, and Peder M Isager. 2018.
“Equivalence Testing for Psychological Research: A
Tutorial.” Advances in Methods and Practices in Psychological
Science 1 (2): 259–69.
Läkens, Daniel. 2017. “Equivalence Tests: A Practical Primer for
t-Tests, Correlations, and Meta-Analyses.” Social
Psychological and Personality Science 1: 1–8. https://doi.org/10.1177/1948550617697177.
Liddell, Torrin M., and John K. Kruschke. 2018. “Analyzing Ordinal
Data with Metric Models: What Could Possibly Go Wrong?”
Journal of Experimental Social Psychology 79 (November):
328–48. https://doi.org/10.1016/j.jesp.2018.08.009.
Lovakov, Andrey, and Elena R. Agadullina. 2021. “Empirically
Derived Guidelines for Effect Size Interpretation in Social
Psychology.” European Journal of Social Psychology 51
(3): 485–504. https://doi.org/10.1002/ejsp.2752.
Lüdecke, Daniel. 2019. Esc: Effect Size Computation for Meta
Analysis (Version 0.5.1). https://doi.org/10.5281/zenodo.1249218.
Magnusson, Kristoffer. 2023. “A Causal Inference Perspective on
Therapist Effects.”
McGlothlin, Anna E., and Roger J. Lewis. 2014. “Minimal Clinically
Important Difference: Defining What Really Matters to Patients.”
JAMA 312 (13): 1342–43. https://doi.org/10.1001/jama.2014.13128.
Meehl, Paul E. 1984. “Radical Behaviorism and Mental Events: Four
Methodological Queries.” Behavioral and Brain Sciences 7
(4): 563–64. https://doi.org/10.1017/S0140525X00027308.
Morey, Richard D., Rink Hoekstra, Jeffrey N. Rouder, Michael D. Lee, and
Eric-Jan Wagenmakers. 2016. “The Fallacy of Placing Confidence in
Confidence Intervals.” Psychonomic Bulletin & Review
23 (1): 103–23. https://doi.org/10.3758/s13423-015-0947-8.
Morris, Scott B. 2008. “Estimating Effect Sizes From
Pretest-Posttest-Control Group Designs.” Organizational
Research Methods 11 (2): 364–86. https://doi.org/10.1177/1094428106291059.
Morse, David. 2018. “How to Calculate Degrees of Freedom When
Using Two Way ANOVA with Unequal Sample Size?”
Munzel, Ullrich, and Edgar Brunner. 2002. “An Exact Paired Rank
Test.” Biometrical Journal 44 (5): 584–93. https://doi.org/10.1002/1521-4036(200207)44:5<584::AID-BIMJ584>3.0.CO;2-9.
Neubert, Karin, and Edgar Brunner. 2007. “A Studentized
Permutation Test for the Non-Parametric Behrensfisher
Problem.” Computational Statistics & Data Analysis
51 (10): 5192–5204. https://doi.org/10.1016/j.csda.2006.05.024.
O’Brien, Ralph G, and John Castelloe. 2006. “Exploiting the Link
Between the Wilcoxon-Mann-Whitney Test and a Simple Odds
Statistic.” In Proceedings of the Thirty-First Annual SAS
Users Group International Conference, 209–31. Citeseer.
Olkin, Ingram, and Jeremy D. Finn. 1995. “Correlations
Redux.” Psychological Bulletin 118 (1): 155–64. https://doi.org/10.1037/0033-2909.118.1.155.
Orben, Amy, and Daniël Lakens. 2020. “Crud (Re)Defined.”
Advances in Methods and Practices in Psychological Science 3
(2): 238–47. https://doi.org/10.1177/2515245920917961.
Otgaar, Henry, Paul Riesthuis, Tess Neal, Jason Chin, Irena Boskovic,
and Eric Rassin. 2023. “If Generalization Is the Grail, Practical
Relevance Is the Nirvana: Considerations from the Contribution of
Psychological Science of Memory to Law.” Henry Otgaar, Paul
Riesthuis, Tess MS Neal, Jason M. Chin, Irena Boskovic & Eric
Rassin,“If Generalization Is the Grail, Practical Relevance Is the
Nirvana: Considerations from the Contribution of Psychological Science
of Memory to Law”(accepted 2023) Journal of Applied Research in
Memory and Co.
Otgaar, Henry, Paul Riesthuis, Johannes G Ramaekers, Maryanne Garry, and
Lilian Kloft. 2022. “The Importance of the Smallest Effect Size of
Interest in Expert Witness Testimony on Alcohol and Memory.”
Frontiers in Psychology 13: 980533.
Panzarella, Emily, Nataly Beribisky, and Robert A Cribbie. 2021.
“Denouncing the Use of Field-Specific Effect Size Distributions to
Inform Magnitude.” PeerJ 9: e11383.
Paterson, Ted A., P. D. Harms, Piers Steel, and Marcus Credé. 2016.
“An Assessment of the Magnitude of Effect Sizes: Evidence From 30
Years of Meta-Analysis in Management.” Journal of Leadership
& Organizational Studies 23 (1): 66–81. https://doi.org/10.1177/1548051815614321.
Peters, Gjalt-Jorn Ygram, and Stefan Gruijters. 2023. Ufs: A
Collection of Utilities. https://ufs.opens.science.
Pogrow, Stanley. 2019. “How Effect Size (Practical Significance)
Misleads Clinical Practice: The Case for Switching to Practical Benefit
to Assess Applied Research Findings.” The American
Statistician 73 (sup1): 223–34. https://doi.org/10.1080/00031305.2018.1549101.
Richard, F. D., Charles F. Bond Jr., and Juli J. Stokes-Zoota. 2003.
“One Hundred Years of Social Psychology Quantitatively
Described.” Review of General Psychology 7 (4): 331–63.
https://doi.org/10.1037/1089-2680.7.4.331.
Riesthuis, Paul, Ivan Mangiulli, Nick Broers, and Henry Otgaar. 2022.
“Expert Opinions on the Smallest Effect Size of Interest in False
Memory Research.” Applied Cognitive Psychology 36 (1):
203–15.
Rossi, Michael J, Jefferson C Brand, and James H Lubowitz. 2023.
“Minimally Clinically Important Difference (MCID) Is a Low
Bar.” Arthroscopy: The Journal of Arthroscopic & Related
Surgery. Elsevier.
Sawilowsky, Shlomo. 2009. “New Effect Size Rules of Thumb.”
Journal of Modern Applied Statistical Methods 8 (2). https://doi.org/10.22237/jmasm/1257035100.
Schäfer, Thomas, and Marcus A. Schwarz. 2019. “The Meaningfulness
of Effect Sizes in Psychological Research: Differences Between
Sub-Disciplines and the Impact of Potential Biases.”
Frontiers in Psychology 10. https://www.frontiersin.org/articles/10.3389/fpsyg.2019.00813.
Senior, Alistair M., Wolfgang Viechtbauer, and Shinichi Nakagawa. 2020.
“Revisiting and Expanding the Meta-Analysis of Variation: The Log
Coefficient of Variation Ratio.” Research Synthesis
Methods 11 (4): 553–67. https://doi.org/10.1002/jrsm.1423.
Spearman, C. 1904. “The Proof and Measurement of Association
Between Two Things.” International Journal of
Epidemiology 39 (5): 1137–50. https://doi.org/10.1093/ije/dyq191.
Steiger, James H. 2004. “Beyond the f Test: Effect Size Confidence
Intervals and Tests of Close Fit in the Analysis of Variance and
Contrast Analysis.” Psychological Methods 9 (2): 164–82.
https://doi.org/10.1037/1082-989X.9.2.164.
Torchiano, Marco. 2020. Effsize: Efficient Effect Size
Computation. https://doi.org/10.5281/zenodo.1480624.
Venables, W. N., and B. D. Ripley. 2002. Modern Applied Statistics
with s. Fourth. New York: Springer. https://www.stats.ox.ac.uk/pub/MASS4/.
Viechtbauer, Wolfgang. 2010. “Conducting Meta-Analyses in
R with the metafor
Package.” Journal of Statistical Software 36 (3): 1–48.
https://doi.org/10.18637/jss.v036.i03.
Vos, Paul, and Don Holbert. 2022. “Frequentist Statistical
Inference Without Repeated Sampling.” Synthese 200 (2):
89. https://doi.org/10.1007/s11229-022-03560-x.
W. T. Hoyt, A. C. Del Re &. 2014. MAd: Meta-Analysis with Mean
Differences. R Package. https://CRAN.R-project.org/package=MAd.
Wellington, Ian J., Annabelle P. Davey, Mark P. Cote, Benjamin C.
Hawthorne, Caitlin G. Dorsey, Patrick M. Garvin, James C. Messina, Cory
R. Hewitt, and Augustus D. Mazzocca. 2023. “Substantial Clinical
Benefit Values Demonstrate a High Degree of Variability When Stratified
by Time and Geographic Region.” JSES International 7
(1): 153–57. https://doi.org/10.1016/j.jseint.2022.10.003.
Wiernik, Brenton M., and Jeffrey A. Dahlke. 2020. “Obtaining
Unbiased Results in Meta-Analysis: The Importance of Correcting for
Statistical Artifacts.” Advances in Methods and Practices in
Psychological Science 3 (1): 94–123. https://doi.org/10.1177/2515245919885611.
William Revelle. 2023. Psych: Procedures for Psychological,
Psychometric, and Personality Research. Evanston, Illinois:
Northwestern University. https://CRAN.R-project.org/package=psych.
Yang, Yefeng, Helmut Hillebrand, Malgorzata Lagisz, Ian Cleasby, and
Shinichi Nakagawa. 2022. “Low Statistical Power and Overestimated
Anthropogenic Impacts, Exacerbated by Publication Bias, Dominate Field
Studies in Global Change Biology.” Global Change Biology
28 (3): 969–89. https://doi.org/10.1111/gcb.15972.