Modelling

This session reviews modelling and analysis and how it impacts the results of studies.

Objective

Underline the impact of various modelling choices on the credibility of our results and discuss some modelling challenges we often face in applied work.

Summary

When building regression models, we make many choices: which variables to include in the model, which functional form, etc. These choices are most often not straightforward and, in this lecture, we discuss some of the challenges associated to the construction of our regression models. We first discuss the causal graph framework and Directed Acyclic Graphs (DAGs) in more details. We then review standard modelling assumptions and discuss what happens when they fail and further discuss a few aspects associated with the choice of controls. When the outcome is limited, eg binary, categorical or censored, usual linear models cannot properly represent the DGP and we need to turn limited outcome models. We discuss some of these models, emphasizing why they are helpful and how to implement and interpret them.

Session Outline

  • Introduction: goals and definitions
  • Causal Graph Framework
  • Failures of Gauss-Markov conditions
  • Controls
  • Limited outcome models
    • LPM, probit, logit
    • Multinomial logit
    • Poisson and negative binomial models
  • Summaries

Materials

Open slides in html

Open slides in pdf

Specific resources for this lecture

DAGs

Modelling

Clustering

References

Abadie, Alberto, Susan Athey, Guido W Imbens, and Jeffrey M Wooldridge. 2023. “When Should You Adjust Standard Errors for Clustering?” The Quarterly Journal of Economics 138 (1): 1–35. https://doi.org/10.1093/qje/qjac038.
Angrist, Joshua D., and Jörn-Steffen Pischke. 2009. Mostly Harmless Econometrics: An Empiricist’s Companion. 1 edition. Princeton: Princeton University Press.
Bertrand, Marianne, Esther Duflo, and Sendhil Mullainathan. 2004. “How Much Should We Trust Differences-In-Differences Estimates?” The Quarterly Journal of Economics 119 (1): 249–75. https://doi.org/10.1162/003355304772839588.
Cunningham, Scott. 2021. Causal Inference: The Mixtape. Yale University Press. https://doi.org/10.2307/j.ctv1c29t27.
Gelman, Andrew, Jennifer Hill, and Aki Vehtari. 2021. Regression and Other Stories.
Huntington-Klein, Nick. 2022. The Effect: An Introduction to Research Design and Causality. 1st edition. Chapman and Hall/CRC.
MacKinnon, James G., Morten Ørregaard Nielsen, and Matthew D. Webb. 2023. “Cluster-Robust Inference: A Guide to Empirical Practice.” Journal of Econometrics 232 (2): 272–99. https://doi.org/10.1016/j.jeconom.2022.04.001.