Abstract
Multiple-baseline designs are an extension of the basic single-case AB phase designs, in which several of those AB designs are implemented simultaneously to different persons, behaviors, or settings, and the intervention is introduced in a staggered way to the different units. These designs are well-suited for research in the behavioral sciences. We discuss the advantages and limitations for valid inferences, and suggest a statistical technique—randomization tests—for use with multiple-baseline data, to complement visual analysis. In addition, we provide an extension of our SCRT-R package (which already contained means for conducting randomization tests on single-case phase and alternation designs), for multiple-baseline AB data.
Article PDF
Similar content being viewed by others
References
Arndt, S., Cizadlo, T., Andreasen, N. C., Heckel, D., Gold, S., & O’Leary, D. S. (1996). Test for comparing images based on randomization and permutation methods. Journal of Cerebral Blood Flow & Metabolism, 16, 1271–1279.
Baer, D. M., Wolf, M. M., & Risley, T. R. (1968). Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 1, 91–97.
Barlow, D. H., & Hersen, M. (1984). Single case experimental designs: Strategies for studying behavior change (2nd ed.). New York: Pergamon.
Besag, J., & Diggle, P. J. (1977). Simple Monte Carlo tests for spatial pattern. Journal of the Royal Statistical Society C, 26, 327–333.
Box, G. E. P., Jenkins, G. M., & Reinsel, G. C. (1994). Time series analysis: Forecasting and control (3rd ed.). Englewood Cliffs, NJ: Prentice Hall.
Bulté, I., & Onghena, P. (2008). An R package for single-case randomization tests. Behavior Research Methods, 40, 467–478.
Christ, T. J. (2007). Experimental control and threats to internal validity of concurrent and nonconcurrent multiple-baseline designs. Psychology in the Schools, 44, 451–459.
Crawley, M. J. (2005). Statistics: An introduction using R. Chichester, U.K.: Wiley.
Crosbie, J. (1993). Interrupted time-series analysis with brief single-subject data. Journal of Consulting & Clinical Psychology, 61, 966–974.
Dalgaard, P. (2002). Introductory statistics with R. New York: Springer.
DeProspero, A., & Cohen, S. (1979). Inconsistent visual analysis of intrasubject data. Journal of Applied Behavior Analysis, 12, 573–579.
Edgington, E. S. (1973). The random-sampling assumption in “Comment on component-randomization tests.” Psychological Bulletin, 80, 84–85.
Edgington, E. S. (1975). Randomization tests for one-subject operant experiments. Journal of Psychology: Interdisciplinary & Applied, 90, 57–68.
Edgington, E. S. (1980). Overcoming obstacles to single-subject experimentation. Journal of Educational Statistics, 5, 261–267.
Edgington, E. S. (1992). Nonparametric tests for single-case experiments. In T. R. Kratochwill & J. R. Levin (Eds.), Single-case research design and analysis: New directions for psychology and education (pp. 133–157). Hillsdale, NJ: Erlbaum.
Edgington, E. S., & Bland, B. H. (1993). Randomization tests: Application to single-cell and other single-unit neuroscience experiments. Journal of Neuroscience Methods, 47, 169–177.
Edgington, E. S., & Onghena, P. (2007). Randomization tests (4th ed.). Boca Raton, FL: Chapman & Hall/CRC.
Ferron, J., Foster-Johnson, L., & Kromrey, J. D. (2003). The functions of single-case randomization tests with and without random assignment. Journal of Experimental Education, 71, 267–288.
Ferron, J., & Jones, P. K. (2006). Tests for the visual analysis of response-guided multiple-baseline data. Journal of Experimental Education, 75, 66–81.
Ferron, J., & Scott, H. (2005). Multiple baseline designs. In B. S. Everitt & D. C. Howell (Eds.), Encyclopedia of statistics in behavioral science (Vol. 3, pp. 1306–1309). New York: Wiley.
Ferron, J., & Sentovich, C. (2002). Statistical power of randomization tests used with multiple-baseline designs. Journal of Experimental Education, 70, 165–178.
Gorman, B. S., & Allison, D. B. (1996). Statistical alternatives for single-case designs. In R. D. Franklin, D. B. Allison, & B. S. Gorman (Eds.), Design and analysis of single-case research (pp. 119–158). Mahwah, NJ: Erlbaum.
Harris, F. N., & Jenson, W. R. (1985). Comparisons of multiple-baseline across persons designs and AB designs with replications: Issues and confusions. Behavioral Assessment, 7, 121–127.
Hartmann, D. P., Gottman, J. M., Jones, R. R., Gardner, W., Kazdin, A. E., & Vaught, R. S. (1980). Interrupted time-series analysis and its application to behavioral data. Journal of Applied Behavior Analysis, 13, 543–559.
Hayes, S. C. (1981). Single case experimental design and empirical clinical practice. Journal of Consulting & Clinical Psychology, 49, 193–211.
Hooton, J. W. (1991). Randomization tests: Statistics for experimenters. Computer Methods & Programs in Biomedicine, 35, 43–51.
Hornik, K. (2008). The R FAQ: Frequently asked questions on R. Retrieved July 18, 2008, from cran.r-project.org/doc/FAQ/.
Kazdin, A. E. (1973). Methodological and assessment considerations in evaluating reinforcement programs in applied settings. Journal of Applied Behavior Analysis, 6, 517–531.
Kazdin, A. E. (1982). Single-case research designs: Methods for clinical and applied settings. New York: Oxford University Press.
Kazdin, A. E. (1984). Statistical analyses for single-case experimental designs. In D. H. Barlow & M. Hersen (Eds.), Single case experimental designs: Strategies for studying behavior change (2nd ed., pp. 258–324). New York: Pergamon.
Kazdin, A. E., & Kopel, S. A. (1975). On resolving ambiguities of the multiple-baseline design: Problems and recommendations. Behavior Therapy, 6, 601–608.
Kelley, K. (2007). Methods for the behavioral, educational, and social sciences: An R package. Behavior Research Methods, 39, 979–984.
Kinugasa, T., Cerin, E., & Hooper, S. (2004). Single-subject research designs and data analyses for assessing elite athletes’ conditioning. Sports Medicine, 34, 1035–1050.
Koehler, M. J., & Levin, J. R. (1998). Regulated randomization: A potentially sharper analytical tool for the multiple-baseline design. Psychological Methods, 3, 206–217.
Koehler, M. J., & Levin, J. R. (2000). RegRand: Statistical software for the multiple-baseline design. Behavior Research Methods, Instruments, & Computers, 32, 367–371.
Leitenberg, H. (1973). The use of single-case methodology in psychotherapy research. Journal of Abnormal Psychology, 82, 87–101.
Long, C. G., & Hollin, C. R. (1995). Single case design: A critique of methodology and analysis of recent trends. Clinical Psychology & Psychotherapy, 2, 177–191.
Ludbrook, J. (1994). Advantages of permutation (randomization) tests in clinical and experimental pharmacology and physiology. Clinical & Experimental Pharmacology & Physiology, 21, 673–686.
Marascuilo, L. A., & Busk, P. L. (1988). Combining statistics for multiple-baseline AB and replicated ABAB designs across subjects. Behavioral Assessment, 10, 1–28.
Matyas, T. A., & Greenwood, K. M. (1990). Visual analysis of singlecase time series: Effects of variability, serial dependence, and magnitude of intervention effects. Journal of Applied Behavioral Analysis, 23, 341–351.
Morley, S., & Adams, M. (1991). Graphical analysis of single-case time series data. British Journal of Clinical Psychology, 30, 97–115.
Murray, D. M., Varnell, S. P., & Blitstein, J. L. (2004). Design and analysis of group-randomized trials: A review of recent methodological developments. American Journal of Public Health, 94, 423–432.
Onghena, P. (1992). Randomization tests for extensions and variations of ABAB single-case experimental designs: A rejoinder. Behavioral Assessment, 14, 153–171.
Onghena, P. (2005). Single case designs. In B. S. Everitt & D. C. Howell (Eds.), Encyclopedia of statistics in behavioral science (Vol. 4, pp. 1850–1854). New York: Wiley.
Onghena, P., & Edgington, E. S. (2005). Customization of pain treatments: Single-case design and analysis. Clinical Journal of Pain, 21, 56–68.
Parsonson, B. S., & Baer, D. M. (1992). The visual analysis of data, and current research into the stimuli controlling it. In T. R. Kratochwill & J. R. Levin (Eds.), Single-case research design and analysis: New directions for psychology and education (pp. 15–40). Hillsdale, NJ: Erlbaum.
Potvin, C., & Roff, D. A. (1993). Distribution-free and robust statistical methods: Viable alternatives to parametric statistics. Ecology, 74, 1617–1628.
Recchia, M., & Rocchetti, M. (1982). The simulated randomization test. Computer Programs in Biomedicine, 15, 111–116.
Robinson, D. H., & Levin, J. R. (1997). Reflections on statistical and substantive significance, with a slice of replication. Educational Researcher, 26, 21–26.
Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin.
Strauss, R. E. (1982). Statistical significance of species clusters in association analysis. Ecology, 63, 634–639.
Todman, J. B., & Dugard, P. (2001). Single-case and small-n experimental designs: A practical guide to randomization tests. Mahwah, NJ: Erlbaum.
Tryon, W. W. (1982). A simplified time-series analysis for evaluating treatment interventions. Journal of Applied Behavior Analysis, 15, 423–429.
Turk, D. C. (2000). Statistical significance and clinical significance are not synonyms! Clinical Journal of Pain, 16, 185–187.
Wampold, B. E., & Worsham, N. L. (1986). Randomization tests for multiple-baseline designs. Behavioral Assessment, 8, 135–143.
Wilson, J. B. (2007). Priorities in statistics, the sensitive feet of elephants, and don’t transform data. Folia Geobotanica, 42, 161–167.
Winch, R. F., & Campbell, D. T. (1969). Proof ? No. Evidence? Yes. The significance of tests of significance. American Sociologist, 4, 140–143.
Zhan, S., & Ottenbacher, K. J. (2001). Single subject research designs for disability research. Disability & Rehabilitation, 23, 1–8.
Ziegler, S. G. (1994). The effects of attentional shift training on the execution of soccer skills: A preliminary investigation. Journal of Applied Behavior Analysis, 27, 545–552.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bulté, I., Onghena, P. Randomization tests for multiple-baseline designs: An extension of the SCRT-R package. Behavior Research Methods 41, 477–485 (2009). https://doi.org/10.3758/BRM.41.2.477
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BRM.41.2.477