Newborn and Infant Nursing Reviews
Volume 10, Issue 1 , Pages 19-26 , March 2010

A Primer on Propensity Score Analysis

  • William R. Shadish, PhD

      Affiliations

    • School of Social Science, Humanities and Arts, University of California, Merced, Merced, CA
    • Corresponding Author InformationAddress correspondence to William R. Shadish, PhD, School of Social Science, Humanities and Arts, University of California, Merced, 5200 N. Lake Rd, Merced, CA 95343.
  • ,
  • Peter M. Steiner, PhD

      Affiliations

    • Institute for Policy Research, Northwestern University, Evanston, IL

References 

  1. Shadish WR, Cook TD, Campbell DT. Experimental and ouasi-experimental designs for generalized causal inference. Boston: Houghton-Mifflin; 2002;
  2. Cook TD. “Waiting for life to Arrive”: a history of the regression-discontinuity design in psychology, statistics and economics. J Econometrics. 2008;142:636–654
  3. Rosenbaum PR, Rubin DB. The central role of the propensity score in observational studies for causal effects. Biometrika. 1983;70:41–55
  4. Rosenbaum PR, Rubin DB. Reducing bias in observational studies using subclassification on the propensity scores. J Am Stat Assoc. 1984;79:516–524
  5. Shadish WR, Clark MH, Steiner PM. Can nonrandomized experiments yield accurate answers? A randomized experiment comparing random to nonrandom assignment. J Am Stat Assoc. 2008;103:1334–1343
  6. Steiner PM, Cook TD, Shadish WR, et al. The importance of covariate selection in controlling for selection bias in observational studies. Psychol Methods. In press.
  7. Cook TD, Steiner PM. Case Matching and the reduction of selection bias in quasi-experiments: the relative importance of the pretest as a covariate, unreliable measurement and mode of data analysis. Psychological Methods. In press.
  8. Steiner PM, Cook TD, Shadish WR. On the importance of reliable covariate measurement in selection bias adjustments using propensity scores. J Educ Behav Stat. In press.
  9. Hastie T, Tibshirani R, Friedman J. The elements of statistical learning. New York: Springer; 2001;
  10. Berk RA. Statistical learning from a regression perspective. New York: Springer; 2008;
  11. Stone RA, Obrosky DS, Singer DE, et al. Propensity score adjustment for pretreatment differences between hospitalized and ambulatory patients with community-acquired pneumonia. Medical Care. 1995;33:AS56–AS66
  12. Berk RA. An introduction to ensemble methods for data analysis. Sociol Methods Res. 2006;34:263–295
  13. McCaffrey DF, Ridgeway G, Morral AR. Propensity score estimation with boosted regression for evaluating causal effects in observational studies. Psychol Methods. 2004;9:403–425
  14. Luellen JK, Shadish WR, Clark MH. Propensity scores: an introduction and experimental test. Evaluation Review. 2005;29:530–558
  15. Berk R, Li A, Hickman LJ. Statistical difficulties in determining the role of race in capital cases: a re-analysis of data from the state of Maryland. J Quant Criminol. 2005;21:365–390
  16. R Development Core Team . R: a language and environment for statistical computing. Vienna (Austria): R Foundation for Statistical Computing; 2009;http://www.R-project.org
  17. Shadish WR, Luellen JK, Clark MH. Propensity scores and quasi-experimentation. In:  Bootzin RR,  McKnight P editor. Strengthening research methodology: psychological measurement and evaluation. Washington (DC): American Psychological Association; 2006;p. 143–157
  18. Ho D, Imai K, King G, et al. Matching as nonparametric preprocessing for reducing model dependence in parametric causal inference. Political Anal. 2007;15:199–236
  19. Rubin DB. Using propensity scores to help design observational studies: application to the tobacco litigation. Health Serv Outcome Res Methodol. 2001;2:169–188
  20. Rubin DB. For objective causal inference, design trumps analysis. Ann Appl Stat. 2008;2:808–840
  21. Robins JM, Rotnitzky A. Semiparametric efficiency in multivariate regression models with missing data. J Am Stat Assoc. 1995;90:122–129
  22. Schafer JL, Kang J. Average causal effects from nonrandomized studies: a practical guide and simulated example. Psychol Methods. 2008;13:279–313
  23. Rosenbaum PR. Observational studies. 2nd ed.. New York: Springer-Verlag; 2002;
  24. Rubin DB. Matched sampling for causal effects. New York: Cambridge University Press; 2006;
  25. Hansen BB. Full matching in an observational study of coaching for the SAT. J Am Stat Assoc. 2004;99:609–619
  26. Stuart EA, Green KM. Using full matching to estimate causal effects in non-experimental studies: examining the relationship between adolescent marijuana use and adult outcomes. Dev Psychol. 2008;44:395–406
  27. Cochran WG. The effectiveness of adjustment by subclassification in removing bias in observational studies. Biometrics. 1968;24:295–313
  28. Hong G, Raudenbush SW. Effects of kindergarten retention policy on children's cognitive growth in reading and mathematics. Educ Eval Policy Anal. 2005;27:205–224
  29. Little RJA, An H. Robust likelihood-based analysis of multivariate data with missing values. Statistica Sinica. 2004;14:949–968
  30. Hirano K, Imbens G, Ridder G. Efficient estimation of average treatment effects using the estimated propensity score. Econometrica. 2003;71:1161–1189
  31. Robins JM, Hernan MA, Brumback B. Marginal structural models and causal inference in epidemiology. Epidemiology. 2000;11:550–560
  32. Cook TD, Shadish WR, Wong VC. Three conditions under which experiments and observational studies produce comparable causal estimates: new findings from within-study comparisons. J Policy Anal Manag. 2008;27:724–750
  33. Glazerman S, Levy DM, Myers D. Nonexperimental versus experimental estimates of earnings impacts. Ann Am Acad. 2003;589:63–93
  34. Shah BR, Laupacis A, Hux JE, Austin PC. Propensity score methods gave similar results to traditional regression modeling in observational studies: a systematic review. J Clin Epidemiol. 2005;58:550–559
  35. Stürmer T, Joshi M, Glynn RJ, Avorn J, Rothman KJ, Schneeweiss S. A review of the application of propensity score methods yielded increasing use, advantages in specific settings, but not substantially different estimates compared with conventional multivariable methods. J Clin Epidemiol. 2006;59:437–447
  36. Parsons LS. Reducing bias in a propensity score matched-pair sample using greedy matching techniques. In: SAS Institute Inc., Proceedings of the Twenty-Sixth Annual SAS Ò Users Group International Conference, Paper 214-26. Cary, NC: SAS Institute Inc.. 2001;http://www2.sas.com/proceedings/sugi26/p214-26.pdf
  37. Kosanke J, Bergstralh E. Match cases to controls using variable optimal matching. http://mayoresearch.mayo.edu/mayo/research/biostat/upload/vmatch.sas2004;
  38. Levesque R. Raynald's SPSS Tools. http://www.spsstools.net/Syntax/RandomSampling/MatchCasesOnBasisOfPropensityScores.txt
  39. Leuven E, Sianesi B. PSMATCH2. Stata module to perform full Mahalanobis and propensity score matching, common support graphing, and covariate imbalance testing. Statistical Software Components S432001. Chestnut Hill, Massachusetts: Boston College Department of Economics; 2003;
  40. Abadie A, Drukker D, Herr JL, Imbens GW. Implementing matching estimators for average treatment effects in Stata. Stata J. 2004;4:290–311
  41. Becker SO, Ichino A. Estimation of average treatment effects based on propensity scores. Stata J. 2002;2:358–377
  42. Ho D, Imai K, King G, Stuart EA. MatchIt: nonparametric preprocessing for parametric causal inference. Journal of Statistical Software. In press.
  43. Sekhon JS. Multivariate and propensity score matching software with automated balance optimization: The matching package for R. Journal of Statistical Software. In press.
  44. Hansen B, Klopfer SO. Optimal full matching and related designs via network flows. J Comput Graphical Stat. 2006;15:609–627
  45. Shadish WR, Cook TD. Design rules: more steps towards a complete theory of quasi-experimentation. Stat Sci. 1999;14:294–300

 The authors were supported in part by grant R305U070003 from the Institute for Educational Sciences, U.S. Department of Education. The second author was also supported by grants from the Spencer Foundation and W.T. Grant Foundation.

PII: S1527-3369(09)00178-0

doi: 10.1053/j.nainr.2009.12.010

Newborn and Infant Nursing Reviews
Volume 10, Issue 1 , Pages 19-26 , March 2010