Probabilistic Software

Probabilistic software is software whose behavior is partly mediated by model judgment rather than fully specified deterministic code. In 当可靠的代码变成了偶尔发疯的OpenClaw，我们未来的工作范式变迁, Keji Luandun uses Open Claw to show the shift: a local agent can search, operate accounts, call tools, write files, change configuration, and keep working, but it may also drift, misread instructions, follow injected prompts, or break its own environment.

The concept does not mean “unusable software.” It means the engineering boundary changes. A probabilistic agent can be valuable when a task is fuzzy, low-risk, and reviewable, while the same agent becomes dangerous when it receives broad local permissions, runs on schedules, acts on money or accounts, or mutates durable state without a recovery path.

Key Claims

• The user’s mental model must shift from command execution to coworker management: specify goals, constrain authority, inspect intermediate work, and accept that retries or corrections may be part of the workflow.
• Agent Harness design becomes a reliability layer because tools, context, memory, sandboxes, trigger rules, and rollback paths decide how much model uncertainty can damage the environment.
• Deterministic subtools still matter. Stable conversion, export, validation, deployment, and audit steps should be handled by code or structured interfaces when possible, leaving model calls for interpretation and judgment.
• Long-running scheduled agents are riskier than one-shot assistant tasks because the same unclear instruction, stale memory, model update, or hidden prompt can repeat or compound.
• Local agents intensify the issue because Local Agent Execution gives them access to browser state, files, accounts, passwords, and private data that a cloud chat bot normally cannot touch.
• Security review itself can be probabilistic when AI is used to judge AI output, so high-impact workflows still need human review, deterministic checks, or domain-specific controls.
• The product question becomes whether the system can expose uncertainty, ask clarifying questions, preserve logs, let users revoke permissions, and recover from wrong action.

Connections

• Open Claw — source case where probabilistic behavior becomes visible in local agent work.
• Agent Permission Boundaries — practical control surface for limiting damage.
• Local Agent Execution — local context and authority that increase both usefulness and risk.
• Agent Harness — tools, context, memory, and orchestration layer that contains model behavior.
• AI Coding Verification — coding-specific response to cheap but uncertain generated output.
• Human-Agent Collaboration — user-facing relationship shift from operating tools to supervising agents.
• Deterministic Audit Data — contrast with facts and evidence that should not be left to probabilistic output alone.
• Routine Agent Automation — recurring tasks where drift and repeated mistakes have higher blast radius.