Trust, Risk & Safety intermediate

AI Incident

An event where an AI system causes or nearly causes harm — increasingly something you must record and report.

An AI incident covers real harm and near misses: discriminatory outcomes, unsafe advice, data leakage, dangerous automated action. Treating them like security incidents — logged, triaged, reviewed — is what turns them into learning rather than repetition. The EU AI Act requires reporting serious incidents for high-risk systems.

In practice: A chatbot promising a refund policy that does not exist, at scale, for six days.