Quiz: Assurance Deficits, Defeaters and Counter Evidence

Assurance deficits occur when there is a gap between what we believe we know about a system’s safety and what we actually know.

An example of an assurance deficit in a healthcare AI system is its performance with rare medical conditions.

Defeaters are pieces of evidence that invalidate existing safety claims.

A defeater in an autonomous vehicle system might be unexpected road signage during real-world deployment.

Counter evidence must always be treated as a genuine safety problem requiring immediate action.