Where is the Rigor When You Need It?

Cartwright, N.

Abstract

When it comes to causal conclusions, rigor matters. To this end we impose high standards for how studies from which we draw causal conclusions are conducted. For instance, we are widely urged to prefer randomized controlled trials (RCTs) or instrumental variable (IV) models to observational studies relying just on correlations, and we have explicit criteria for what counts as a good RCT or a good IV model. But we tend to be shockingly sloppy when it comes to making explicit just what the causal conclusions we draw mean, why the methods we employ are good for establishing conclusions with just that meaning, and what can defensibly be taken to follow from these claims. With respect to what can be inferred from the limited causal conclusions our studies support, we are far too prone to over reach, to ‘generalize’ that what holds in a study or handful of studies holds widely. But, I shall argue, we do not get arrant for general claims by generalizing. Rather it takes a great tangle of scientific work to support a general claim, including a great deal of conceptual development, theory and the confirmation of a variety of different kinds of effects that the general claim implies.

Citation

Cartwright, N. (2016). Where is the Rigor When You Need It?. Foundations and trends in accounting, 10(2-4), 106-124. https://doi.org/10.1561/1400000045

• Journal Article Type: Article
• Acceptance Date: Sep 15, 2015
• Online Publication Date: Aug 17, 2016
• Publication Date: Aug 17, 2016
• Deposit Date: Sep 15, 2015
• Publicly Available Date: Jul 13, 2017
• Journal: Foundations and Trends in Accounting
• Print ISSN: 1554-0642
• Electronic ISSN: 1554-0650
• Publisher: Now Publishers
• Peer Reviewed: Peer Reviewed
• Volume: 10
• Issue: 2-4
• Pages: 106-124
• DOI: https://doi.org/10.1561/1400000045
• Public URL: https://durham-repository.worktribe.com/output/1431628