AI Recognition Bias
AI recognition bias is the failure mode where a classifier appears to recognize the intended object but is partly relying on irrelevant training signals. In Episode 18: 感官放大世界:和任宁聊观鸟、自然与自由, 任宁 / Ren Ning describes this through bird-recognition tools such as 懂鸟 / Dongniao: rare bird photos are scarce, so a model may learn photographer, camera, or background patterns instead of the bird traits humans care about.
The concept is a concrete computer-vision version of Human Judgment Under AI. AI can accelerate identification, but field knowledge and evidence still matter when records are rare, images are ambiguous, or downstream data will enter Citizen Science records.
Key Claims
- Sparse rare-class data makes models more likely to learn spurious correlations.
- The model’s high confidence does not prove it used the same traits a domain expert would use.
- Training data can encode photographer behavior, location bias, camera artifacts, and background conditions.
- Recognition tools should support field observation and verification rather than replace them.
Connections
- 懂鸟 / Dongniao - source tool example.
- Birdwatching As Attention - human observational practice that model output should support.
- Citizen Science - data quality matters when identifications become shared records.
- Human Judgment Under AI - broader verification and responsibility frame.
- Representation Learning - adjacent machine-learning concept about learned abstractions.