Updated · 1 episodes · 1 show · 1 source notes

concept Topics: Technology

Participatory AI Safety

Definition

Participatory AI safety is the view that people concerned about AI harms should gain enough access, capability, and decision power to test systems and build alternatives while retaining explicit safeguards, risk analysis, and the option to limit use.

Current Synthesis

In Tara Chklovski’s account, criticism and construction should inform each other. Refusing all contact can leave product decisions to existing builders, while enthusiastic adoption without alignment, access, or harm analysis can reproduce the risks critics identify. Participation therefore means informed agency, not unconditional use.

The inclusion dimension is material. If care work, social norms, confidence gaps, or unequal discretionary time make women and other groups later adopters, an invitation to “participate” is insufficient. Mentorship, protected learning time, tool access, local problem authority, and safeguards against displacement are part of who gets to shape technology. The source offers a normative and programmatic position, not evidence that participation alone makes systems safe.

Key Claims

  • External criticism can identify harms, but builders also need affected perspectives inside design and testing.
  • Participation requires understanding both capabilities and dangers rather than assuming use is inherently empowering.
  • Unequal time, access, confidence, and power can determine whose values enter technological development.
  • Building alternatives can convert safety concerns into concrete design choices and locally relevant systems.
  • Access controls, verification, and the option to withhold tools remain compatible with participatory development.
  • Participation is one input to safety, not a substitute for technical evaluation, governance, or accountability.

Evidence

Counterevidence & Qualifications

  • Participation can expose learners and communities to privacy, manipulation, bias, safety, and dependency risks; access without governance is not protection.
  • Diverse participation does not guarantee safe products, correct threat models, institutional power, or the ability to stop deployment.
  • The source does not measure the asserted gender gap in experimentation time or show that building experience changes safety outcomes.
  • Some risks require independent audit, regulation, collective restraint, or refusal rather than additional product participation.

What Changed

  • Established a critic-builder feedback model for AI safety.
  • Added unequal experimentation time and protected access as participation constraints.
  • Bounded participation as complementary to governance and technical safety work.

Sources

1 source notes across 1 show
  1. AI, Education and the Fight for Equal Opportunity | Tara Chklovski x Shekhar Natarajan Tomorrow, Today