Who should we fear more: biohackers, disgruntled postdocs, or bad governments? a simple risk chain model of biorisk
Abstract:
The biological risk landscape continues to evolve as developments in synthetic biology and biotechnology offer increasingly powerful tools to a widening pool of actors, including those who may consider carrying out a deliberate biological attack. However, it remains unclear whether it is the relatively large numbers of low-resourced actors or the small handful of high-powered actors who pose a greater biosecurity risk. To answer this question, this paper introduces a simple risk chain model of biorisk, from actor intent to a biological event, where the actor can successfully pass through each of N steps. Assuming that actor success probability at each independent step is sigmoidally distributed and actor power follows a power-law distribution, if a biorisk event were to occur, this model shows that the expected perpetrator would likely be highly powered, despite lower-powered actors being far more numerous. However, as the number of necessary steps leading to a biological release scenario decreases, lower-powered actors can quickly overtake more powerful actors as the likely source of a given event. If steps in the risk chain are of unequal difficulty, this model shows that actors are primarily limited by the most difficult step. These results have implications for biosecurity risk assessment and health security strengthening initiatives and highlight the need to consider actor power and ensure that the steps leading to a biorisk event are sufficiently difficult and not easily bypassed.Defence in depth against human extinction: prevention, response, resilience, and why they all matter
Abstract:
We look at classifying extinction risks in three different ways, which affect how we can intervene to reduce risk. First, how does it start causing damage? Second, how does it reach the scale of a global catastrophe? Third, how does it reach everyone? In all of these three phases there is a defence layer that blocks most risks: First, we can prevent catastrophes from occurring. Second, we can respond to catastrophes before they reach a global scale. Third, humanity is resilient against extinction even in the face of global catastrophes. The largest probability of extinction is posed when all of these defences are weak, that is, by risks we are unlikely to prevent, unlikely to successfully respond to, and unlikely to be resilient against. We find that it’s usually best to invest significantly into strengthening all three defence layers. We also suggest ways to do so tailored to the classes of risk we identify. Lastly, we discuss the importance of underlying risk factors – events or structural conditions that may weaken the defence layers even without posing a risk of immediate extinction themselves.Modelling the Social Dynamics of Moral Enhancement: Social Strategies Sold Over-the-Counter and the Stability of Society—ADDENDUM
AI, Good and Evil… and Moloch
Long-term trajectories of human civilization
Abstract:
Purpose
This paper aims to formalize long-term trajectories of human civilization as a scientific and ethical field of study. The long-term trajectory of human civilization can be defined as the path that human civilization takes during the entire future time period in which human civilization could continue to exist.
Design/methodology/approach
This paper focuses on four types of trajectories: status quo trajectories, in which human civilization persists in a state broadly similar to its current state into the distant future; catastrophe trajectories, in which one or more events cause significant harm to human civilization; technological transformation trajectories, in which radical technological breakthroughs put human civilization on a fundamentally different course; and astronomical trajectories, in which human civilization expands beyond its home planet and into the accessible portions of the cosmos.
Findings
Status quo trajectories appear unlikely to persist into the distant future, especially in light of long-term astronomical processes. Several catastrophe, technological transformation and astronomical trajectories appear possible.
Originality/value
Some current actions may be able to affect the long-term trajectory. Whether these actions should be pursued depends on a mix of empirical and ethical factors. For some ethical frameworks, these actions may be especially important to pursue.