Moratorium Distributional Burden
Updated · 1 episodes · 1 show · 1 source notes
Definition
Moratorium distributional burden is the unequal loss of time, priority, income, career opportunity, or voice that a collective pause can impose even when the pause produces a wider safety benefit.
Current Synthesis
Collective restraint is usually evaluated through aggregate risk reduction and defection control, but the Asilomar account adds a person-level ledger. Janet Mertz says the recombinant-DNA moratorium eliminated a substantial lead and harmed her career, while senior scientists negotiated rules at a conference she did not attend. Her judgment that the pause was still worthwhile does not erase the cost; it makes compensation, representation, credit, and burden-sharing part of legitimate governance.
The concept does not imply that a costly moratorium is wrong. It requires decision-makers to identify who loses first-mover advantage, who has a voice in setting scope and exit conditions, and whether institutions can reduce concentrated harm without weakening the safety objective.
Key Claims
- Aggregate safety gains can coexist with severe individual opportunity costs.
- Early-career researchers and smaller organizations may lose more from delay than established leaders with diversified resources.
- Exclusion from rule-making compounds material loss by separating burden from voice.
- Consent to a policy’s public value does not waive a fair accounting of its private cost.
- Compensation, credit protection, representation, and explicit exit criteria can improve legitimacy without rejecting restraint.
Evidence
- Career and priority loss: Wanna slow down AI? These biologists can help. reports Mertz’s view that the pause removed her lead and damaged her career.
- Voice asymmetry: Wanna slow down AI? These biologists can help. says graduate students such as Mertz were not invited and women were scarce at the conference.
- Qualified acceptance: Wanna slow down AI? These biologists can help. records her conclusion that the moratorium remained worthwhile for the wider world.
Counterevidence & Qualifications
This concept is grounded in one retrospective case and does not quantify Mertz’s counterfactual career path. Broader participation can improve legitimacy but can also slow urgent negotiation, and compensation may be hard to calculate when scientific priority is uncertain. Distributional review should therefore qualify, not automatically veto, emergency safety action.
What Changed
- Established unequal career cost and excluded voice as explicit criteria for evaluating technology moratoriums.
Related Concepts
- Asilomar Conference Governance - historical governance case that reveals the burden.
- Incentive-Compatible AI Safety - incentive frame that must include differently resourced participants.
- Advanced AI Development Pause - AI proposal that should specify who bears delay and how work resumes.
- AI Regulatory Capture Risk - adjacent risk that costly safety rules entrench already powerful actors.
Sources
1 source notes across 1 show
- Wanna slow down AI? These biologists can help. Planet Money