Improving institutional decision-makingHow can we improve the effectiveness of institutions in solving important problems?
Interested in working on this research direction? Apply for our coaching
This profile is tailored towards students studying economics, history, philosophy, political sciences, psychology, sociology and maths, however we expect there to be valuable open research questions that could be pursued by students in other disciplines.
Why is this a pressing problem?
Decisions made within institutions such as governments, charities and research organisations have a huge impact on the trajectory of many lives. Institutions influence major actions such as whether a country goes to war, what interventions are taken to alleviate poverty, what policies are adopted in the event of a pandemic and how countries coordinate on global risks such as climate change, biological weapons and artificial intelligence.
The Effective Institutions Project identifies two facets that determine the quality of an institution’s decision-making: how altruistically motivated their decisions are and their technical competence (see also this report). For example, an institution could be very good at achieving goals that don’t support the common good (high decision-quality, low value alignment). Alternatively, an institution could have highly altruistic goals but make decisions with negative consequences, for example due to some of the cognitive biases that psychology research has shown to affect human judgement (high value alignment, low decision-quality).
It could be valuable to do further research to increase both of these organisational characteristics (decision-quality, value-alignment). For example: what goals should an institution aiming to be altruistic adopt, how do we incentivise institutions to adopt more altruistic goals, and how do we help institutions achieve these goals?
Explore existing research
- Bradfield, Ronald, et al. (2016) The Critical Role of History in Scenario Thinking: Augmenting Causal Analysis within the Intuitive Logics Scenario Development Methodology, Futures
- Cairney, Paul & Christopher M. Weible (2017) The New Policy Sciences: Combining the Cognitive Science of Choice, Multiple Theories of Context, and Basic and Applied Analysis, Policy Sciences
- Coulthart, Stephen J. (2017) An Evidence-Based Evaluation of 12 Core Structured Analytic Techniques, International Journal of Intelligence and CounterIntelligence
- Effective Institutions Project (2022) A Landscape Analysis of Institutional Improvement Opportunities
- Gerschman, Samuel J., et al. (2015) Computational Rationality: A Converging Paradigm for Intelligence in Brains, Minds, and Machines, Science
- Helbing, Dirk, et al. (2015) Saving Human Lives: What Complexity Science and Information Systems can Contribute, Journal of Statistical Physics
- Stauffer, Maxime, et al. (2021) Computational Policy Process Studies
- Stauffer, Maxime, et al. (2021) Policymaking for the Long-Term Future: Improving Institutional Fit
- Vivalt, Eva & Aidan Coville (2022) How Do Policy-Makers Update Their Beliefs?, Journal of Development Economics
- The Institute for Government, a UK think tank working to make government more effective.
- The Organisation for Economic Co-operation and Development, an international organisation that works to build better policies.
- The Effective Institutions Project, a global working group incubating high-impact strategies to improve institutional decision-making.
- fp21, a think tank working on improving the process and institutions of US foreign policy.
- What Works Network, a group of organizations aiming to improve the way public sector organisations create, share and use high-quality evidence in decision-making.
- The Behavioural Insights Team, an organisation applying behavioural insights to developing systems, interventions and policies for social impact.
- Making Conversations Smarter, Faster is a project led by Professors Philip Tetlock and Barbara Mellers to develop a collective reasoning system to enhance processes like policy debates or collective forecasting exercises.
- Good Judgement offers training and services relating to forecasting.
- Crowdsourcing Evidence, Argumentation, Thinking and Evaluation, a project by IARPA that developed tools and methods to improve analytic reasoning.
- Ideas42 does behavioural science research across a number of areas to support beneficial behaviour change across society.
- Hubbard Decision Research, a decision-making consultancy and training organisation.
- The Update Project brings together thinkers across fields like tech, academia, the nonprofit world, or government, and aims to help them improve their understanding of the world through discussion.
Organisations focused specifically on decision-making for future generations
- All-Party Parliamentary Group for Future Generations, which aims to create cross-party dialogue on internalising concern for future generations into policy making.
- The Simon Institute for Longterm Governance, which is supporting policy makers to mitigate global catastrophic risk and build a flourishing civilisation.
- The Quantified Uncertainty Research Institute, which researches practices to help governmental and philanthropic bodies to coordinate and make good decisions.
- Simon, Herbert A. (1947) Administrative Behaviour: A Study of Decision-Making Processes in Administrative Organization, Macmillan
- Tetlock, Philip (2017) Expert Political Judgment: How Good Is It? How Can We Know?, Princeton University Press
Find a thesis topic
If you’re interested in working on this research direction, below are some ideas on what would be valuable to explore further. If you want help refining your research ideas, apply for our coaching!
Some examples of research questions we think it could be particularly valuable to work on are:
- What are some key learnings from the field of ‘mechanism design’ that are relevant for improving institutional decision making?
- When faced with an important, irreversible decision for which relevant information will soon be obtained, a social planner may preserve ‘option value’ by delaying the decision until after the information has been acquired (cf. Bishop 1982; Dixit and Pindyck 1994). In delaying an important social decision intergenerationally, however, the planner may worry that future agents’ values and preferences will differ from their own (INFORMAL: Hanson 2018). Facing this tradeoff, under what conditions should the planner – or principal – defer irreversible decisions to better-informed future agents (MacAskill, MS) (INFORMAL: Brauner and Grosse-Holz 2018)? Can long-term intergenerational mechanisms help to overcome this principal-agent problem? What might they look like (Bostrom 2006) (INFORMAL: Tomasik 2018)? (The Global Priorities Institute research agenda)
Here are some other areas for further research on improving institutional decision making.
Ideas for topics that could be useful to explore further:
- How have better practices have been implemented in organisations historically, and what happened badly in the event of major decisions?
- What are some case studies and/or formal evaluations of attempts to improve decision-making environments in powerful institutions, and what outcomes have resulted from them? (Effective Institutions Project)
- How and why were new institutions created? When have these outperformed existing institutions? When might it make sense to scrap and recreate an institution vs. reforming it?
Here are some other areas for further research on improving institutional decision making.
You could draw from Helbing, et al. (2015) to learn more about using mathematical and computational models to understand or support decision-making. Another path could be applications of computational rationality to political decisions and the resulting use of heuristics (Gerschman et al., 2015, Gigerenzer & Gaissmaier, 2011).
Here are some other areas for further research on improving institutional decision making.
Some examples of research questions we think it could be particularly valuable to work on are:
- ‘To what extent ought a government to take actions that are better for the world even if they conflict with the preferences of, and/or are worse for, their own citizens (Goodin 1995)? What about the relationship between corporate philanthropy and shareholder preference/interest?’ (Global Priorities Institute)
- ‘What can considerations of international distributive justice (Blake and Smith 2020) tell us about a fair allocation of benefits and burdens related to institutional mechanisms that facilitate international cooperation in the provision of global public goods, such as the mitigation of global catastrophic risks from emerging technologies (Dafoe 2018)?’ (Global Priorities Institute)
Some examples of research questions we think it could be particularly valuable to work on are:
- ‘Which types of political systems and institutions place a higher weight on long-run outcomes? For example, are democratic systems fundamentally more ‘short-termist’ than non-democratic systems, because of the political pressure of elections (Harstad 2020)? If yes, to what extent can such short-termist pressures be mitigated?’ (Global Priorities Institute)
- ‘Is there a strong case for enfranchising future generations (Kavka and Warren 1983; Goodin 2007; Tännsjö 2007; Beckman 2009: Ch. 7)? If so, how should this be implemented? How effectively can contemporary individuals act as representatives for future generations? Might other democratic reforms, such as age-weighting, help to better align political outcomes with long-term priorities (Gonzalez-Ricoy and Gosseries 2017) (INFORMAL: MacAskill 2019)?’ (Global Priorities Institute)
It could also be useful to look into how practices have been improved in organisations historically, and what went badly in the event of major decisions. Another option could be looking into how policy-makers individually work with evidence and update their beliefs (see this paper and this blog post).
Here are some other areas for further research on improving institutional decision making.
Psychology and cognitive sciences
80000 hours suggests rigorously testing existing decision-making techniques to get strong evidence of effectiveness. Next steps could involve testing techniques that look the most promising – such as calibration training or structured analytic techniques – in more specific contexts (i.e. specific organisations or parts of governments) and on real-world judgements. Another option could be looking into how policy-makers work individually with evidence and update their beliefs (see this paper and this blog post).
Further research could also develop better methods for evaluating the quality of arguments when there is no “correct” answer – see the projects here, here, and here for examples.
Here are some other areas for further research on improving institutional decision making.
Research projects we think it could be particularly valuable to work on are:
- Carrying out ethnographies/deep qualitative investigations of key groups of decision-makers such as AI lab researchers, national security officials in the US government, bioengineers, regulators in key tech regulation functions. This kind of research might provide detail-rich insights about the culture within these groups, their mental models, and other relevant dynamics that are useful when engaging or trying to influence these sets of actors.
- Exploring the question of whether, if individuals or a group become better calibrated due to decision-making techniques, this actually moves the needle within large institutions. When are incentive structures and other powerful status-quo forces so strong that better judgement fails?
- Conducting case studies on how better practices have been implemented in organisations historically or analysis on what went badly during major decisions.
You could also look into Administrative behaviour and the new policy sciences. Here are some other areas for further research on improving institutional decision making.
Further resources
80000 hours has a number of podcast episodes relevant to this research direction:
- Accurately predicting the future is central to absolutely everything. Professor Tetlock has spent 40 years studying how to do it better
- Mushtaq Khan on using institutional economics to predict effective government reforms
- Audrey Tang on what we can learn from Taiwan’s experiments with how to do democracy
You could also explore the texts listed here, which are focused on how institutions can take the longterm future into account.
Find supervision, mentorship and collaboration
Apply for our coaching and we can connect you with researchers already working in this space, who can help you refine your research ideas. You can also apply to join our community if you’re interested in meeting other students working on this research direction.
Apply for our database of potential supervisors if you’re looking for formal supervision and take a look at our advice on finding a great supervisor for further ideas.
You could also join this community of behavioural scientists to connect with other researchers interested in this area and the Facebook group and Slack channel run by the Effective Institutions Project.
Academic research groups relevant to this direction include:
- The Behavioural Insights Group at the Harvard Kennedy School
- The Operations, Information and Decisions Group at the Wharton School, Pennsylvania
- The Decision Sciences Group at Duke’s Fuqua School of Business
- The Center for Decision Research at The University of Chicago Booth School of Business
- The Behavioural Science Group at Warwick Business School
- Innovation for Sucessful Societies at Princeton University
- BehaviourWorks Australia at Monash University
- The Causal Cognition Lab at UCL
- The Reasoning and Argumentation Lab at Birkbeck
Our funding database can help you find potential sources of funding if you’re a PhD student interested in this research direction.
Sign up for our newsletter to hear about opportunities such as funding, internships and research roles.
You could also explore our profile on ‘Reducing risks from malevolent actors’ if you’re interested in the question of how to reduce the chance that leaders with dangerous traits gain positions of power.
Contributors
This profile was last updated 5/1/2023. Thanks to Michael Noetel, Sophia Brown and Jam Kraprayoon for helpful feedback on this profile. All errors remain our own. Learn more about how we create our profiles.
Where next?
Keep exploring our other services and content
Our recommended research directions
Explore areas where we think further research could have a particularly positive impact on the world.
Apply for coaching
Want to work on one of our recommended research directions? Apply for coaching to receive personalised guidance.
Advice
Read our advice on doing impactful research.
Explore all our services
Learn about all the services we offer to help you have more impact with your research career.