What are the internal and external threats to validity of experimental research?

Review

. 2001 Nov 15;58(22):2173-81; quiz 2182-3.

Affiliations

  • PMID: 11760921

Review

Establishing the internal and external validity of experimental studies

M K Slack et al. Am J Health Syst Pharm. 2001.

Abstract

The information needed to determine the internal and external validity of an experimental study is discussed. Internal validity is the degree to which a study establishes the cause-and-effect relationship between the treatment and the observed outcome. Establishing the internal validity of a study is based on a logical process. For a research report, the logical framework is provided by the report's structure. The methods section describes what procedures were followed to minimize threats to internal validity, the results section reports the relevant data, and the discussion section assesses the influence of bias. Eight threats to internal validity have been defined: history, maturation, testing, instrumentation, regression, selection, experimental mortality, and an interaction of threats. A cognitive map may be used to guide investigators when addressing validity in a research report. The map is based on the premise that information in the report evolves from one section to the next to provide a complete logical description of each internal-validity problem. The map addresses experimental mortality, randomization, blinding, placebo effects, and adherence to the study protocol. Threats to internal validity may be a source of extraneous variance when the findings are not significant. External validity is addressed by delineating inclusion and exclusion criteria, describing subjects in terms of relevant variables, and assessing generalizability. By using a cognitive map, investigators reporting an experimental study can systematically address internal and external validity so that the effects of the treatment are accurately portrayed and generalization of the findings is appropriate.

Similar articles

  • Causality and control: threats to internal validity.

    Behi R, Nolan M. Behi R, et al. Br J Nurs. 1996 Mar 28-Apr 10;5(6):374-7. doi: 10.12968/bjon.1996.5.6.374. Br J Nurs. 1996. PMID: 8704467 Review.

  • Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity.

    Godwin M, Ruhland L, Casson I, MacDonald S, Delva D, Birtwhistle R, Lam M, Seguin R. Godwin M, et al. BMC Med Res Methodol. 2003 Dec 22;3:28. doi: 10.1186/1471-2288-3-28. BMC Med Res Methodol. 2003. PMID: 14690550 Free PMC article.

  • External validity, generalizability, and knowledge utilization.

    Ferguson L. Ferguson L. J Nurs Scholarsh. 2004;36(1):16-22. doi: 10.1111/j.1547-5069.2004.04006.x. J Nurs Scholarsh. 2004. PMID: 15098414 Review.

  • Threats to the validity of clinical trials employing enrichment strategies for sample selection.

    Leber PD, Davis CS. Leber PD, et al. Control Clin Trials. 1998 Apr;19(2):178-87. doi: 10.1016/s0197-2456(97)00118-9. Control Clin Trials. 1998. PMID: 9551282

  • Threats to the Internal Validity of Experimental and Quasi-Experimental Research in Healthcare.

    Flannelly KJ, Flannelly LT, Jankowski KRB. Flannelly KJ, et al. J Health Care Chaplain. 2018 Jul-Sep;24(3):107-130. doi: 10.1080/08854726.2017.1421019. Epub 2018 Jan 24. J Health Care Chaplain. 2018. PMID: 29364793

Cited by

  • The STress-And-Coping suppoRT Intervention (START) for Chinese Women Undergoing Abortion: A Randomized Controlled Trial Protocol.

    Wang N, Zhu X, Gamble J, Elder E, Allen J, Creedy DK. Wang N, et al. Int J Environ Res Public Health. 2022 May 28;19(11):6611. doi: 10.3390/ijerph29116611. Int J Environ Res Public Health. 2022. PMID: 35682201 Free PMC article.

  • Implementing Remote Developmental Research: A Case Study of a Randomized Controlled Trial Language Intervention During COVID-19.

    Ozernov-Palchik O, Olson HA, Arechiga XM, Kentala H, Solorio-Fielder JL, Wang KL, Torres YC, Gardino ND, Dieffenbach JR, Gabrieli JDE. Ozernov-Palchik O, et al. Front Psychol. 2022 Jan 7;12:734375. doi: 10.3389/fpsyg.2021.734375. eCollection 2021. Front Psychol. 2022. PMID: 35069315 Free PMC article.

  • Challenging the Boundaries of the Physical Self: Distal Cues Impact Body Ownership.

    Grechuta K, De La Torre Costa J, Ballester BR, Verschure P. Grechuta K, et al. Front Hum Neurosci. 2021 Oct 14;15:704414. doi: 10.3389/fnhum.2021.704414. eCollection 2021. Front Hum Neurosci. 2021. PMID: 34720905 Free PMC article.

  • Transcranial direct current stimulation (tDCS) in addition to walking training on walking, mobility, and reduction of falls in Parkinson's disease: study protocol for a randomized clinical trial.

    Nascimento LR, Nakamura-Palacios EM, Boening A, Cordeiro BNL, Cabral DL, Swarowsky A, Arêas GPT, Paiva WS, da Silva Arêas FZ. Nascimento LR, et al. Trials. 2021 Sep 21;22(1):647. doi: 10.1186/s13063-021-05603-z. Trials. 2021. PMID: 34548110 Free PMC article.

Publication types

MeSH terms

Substances

LinkOut - more resources

  • Full Text Sources

    • Ovid Technologies, Inc.

What are internal and external threats to validity when an experimental research is conducted?

Internal validity is the degree of confidence that the causal relationship you are testing is not influenced by other factors or variables. External validity is the extent to which your results can be generalized to other contexts. The validity of your experiment depends on your experimental design.

What are threats to internal validity of experimental studies?

There are eight threats to internal validity: history, maturation, instrumentation, testing, selection bias, regression to the mean, social interaction and attrition.

What are four common threats to internal validity when conducting experimental research designs?

History, maturation, selection, mortality and interaction of selection and the experimental variable are all threats to the internal validity of this design.

What are three major threats to the internal validity of experiments and possible solutions?

Threats to Internal Validity.
Attrition: Attrition is bad for your research because it leads to a bias. ... .
Confounding variables: When your research has an extra variable related to the treatment you applied to your sample group that affects your results, then that leads to confusion. ... .
Diffusion: This is a tricky one..