Resources for Veridical Testimony in Management Research
Last Updated April 9, 2021
If you have a suggested addition, please email brentg@umd.edu
Background:
Andrew A. King, Brent Goldfarb, and Timothy S. Simcoe “Learning from Testimony on Quantitative Research in Management”, forthcoming, Academy of Management Review. https://doi.org/10.5465/amr.2018.0421.
Hacking, I. (2001). An Introduction to Probability and Inductive Logic. In An Introduction to Probability and Inductive Logic. https://doi.org/10.1017/CBO9780511801297
Evan Starr and Brent Goldfarb. “A Binned Scatterplot Is Worth a Hundred Regressions: Diffusing a Simple Tool to Make Empirical Research Easier and Better”, (2020) Strategic Management Journal 41(12):2261-2274. . https://doi.org/10.1002/smj.3199. (Final working paper copy).
Prespecification & The Problem of P
Olken, B. A. (2015). Promises and Perils of Pre-Analysis Plans. https://doi.org/10.1257/jep.29.3.61
Spanos, A. (2013). A frequentist interpretation of probability for model-based inductive inference. Synthese, 190(9). https://doi.org/10.1007/s11229-011-9892-x
Spanos, A. (2010). "Is frequentist testing vulnerable to the base-rate fallacy?"Philosophy ofScience 77(4): 565-583.
Simonsohn, U., Simmons, J. P., & Nelson, L. D. (2020). Specification curve analysis. Nature Human Behaviour, 4(11). https://doi.org/10.1038/s41562-020-0912-z
Gelman, A. (2014). "Preregistration: what’s in it for you?" Retrieved August, 28, 2019, https://statmodeling.stat.columbia.edu/2014/03/10/preregistration-whats/.
Brent Goldfarb and Andrew King, “Scientific Apophenia in Strategic Management Research: Significance Tests and Mistaken Inference.” (2016), Strategic Management Journal 37(1): 167-176.
Bettis, R. A. (2012). "The search for asterisks: Compromised statistical tests and flawed theories." Strategic Management Journal 33(1): 108-113.
Debate on making Belief Claims (Causality)
Heckman, J. J. (2000). Causal Parameters and Policy Analysis in Economics: A Twentieth Century Retrospective*. Quarterly Journal of Economics, 115(1), 45–97. https://doi.org/10.1162/003355300554674
Angrist, J. D., & Pischke, J.-S. (2010). The Credibility Revolution in Empirical Economics: How Better Research Design is Taking the Con out of Econometrics. Journal of Economic Perspectives, 24(2), 3–30. https://doi.org/10.1257/jep.24.2.3
Experiments in Strategy Research
Di Stefano, G., & Gutierrez, C. (2019). Under a magnifying glass: On the use of experiments in strategy research. Strategic Organization, 17(4), 497–507. https://doi.org/10.1177/1476127018803840
Abduction/Inference to the Best Explanation (IBE)
Douven, I. (2011). Abduction. Retrieved September 4, 2020, from The Stanford Encyclopedia of Philosophy (Summer 2017 Edition) website: https://plato.stanford.edu/archives/sum2017/entries/abduction/
Lipton, P. (2004). Inference to the Best Explanation. Routledge.
Woodward, J. (2000). Explanation and invariance in the special sciences. British Journal for the Philosophy of Science, 51(2), 197–254. https://doi.org/10.1093/bjps/51.2.197
Heckman, J. J. and B. Singer (2017). "Abducting Economics." American Economic Review
107(5): 298-302.
Tools for IBE
Evan Starr and Brent Goldfarb. “A Binned Scatterplot Is Worth a Hundred Regressions: Diffusing a Simple Tool to Make Empirical Research Easier and Better”, (2020) Strategic Management Journal 41(12):2261-2274. . https://doi.org/10.1002/smj.3199. (Final working paper copy).
Sandeep Devanatha Pillai, Brent Goldfarb and David A. Kirsch, (2021). “Lovely and Likely: Using Historical Methods to Improve Inference to the Best Explanation in Strategy”.
Examples of IBE Papers
Sandeep Devanatha Pillai, Brent Goldfarb, and David Kirsch, “The Origins of Firm Strategy: Learning by Economic Experimentation and Strategic Pivots in the Early Automobile Industry”. (2020) Strategic Management Journal. 41(3): 369-399.
Epistemic Mapping:
Leamer, E. E. (1985). Sensitivity analyses would help. American Economic Review, Vol. 75. https://doi.org/10.1016/0169-2070(86)90114-7
Leamer, E. E. (1983). "Let's take the con out of econometrics." The American Economic Review 73(1): 31-43
Leamer, E. E. (2010). "Tantalus on the Road to Asymptopia." Journal of Economic Perspectives 24(2): 31-46.
Andrew A. King, Brent Goldfarb, and Timothy S. Simcoe “Learning from Testimony on Quantitative Research in Management”, forthcoming, Academy of Management Review. https://doi.org/10.5465/amr.2018.0421.
Mapping Tools
Young, C., & Holsteen, K. (2017). Model Uncertainty and Robustness. Sociological Methods & Research, 46(1), 3–40. https://doi.org/10.1177/0049124115610347
Simonsohn, Simmons, Nelson (2020) “Specification Curve Analysis Descriptive and Inferential Statistics for all Plausible Specifications” (.pdf| STATA files .zip) Nature Human Behaviour; note: STATA files are heavily commented, useful for R users too.
Cristobal Young has a nice Stata routine for mapping that works with several empirical models: http://cristobalyoung.com/development/?page_id=62
Uri Simohnson has put together a list of other mapping routines: http://urisohn.com/specification-curve/
Mapping Examples
Brent Goldfarb and Liyue Yan. (2021). “Revisiting Zuckerman's (1999) Categorical Imperative: An Application of Epistemic Maps for Replication, forthcoming, Strategic Management Journal (Appendix).
Durlauf, S. N., S. Navarro and D. A. Rivers (2016). "Model uncertainty and the effect of shall-issue right-to-carry laws on crime." European Economic Review 81: 32-67. (This paper maps specifications implemented in a broad range of studies.)