Trust, Risk & Safety advanced

Interpretability

Understanding how a model works internally, as opposed to just describing its outputs.

Interpretability is the mechanistic question: what are these weights and activations actually computing? It is harder than explainability and more valuable, because it can reveal failure modes before they appear in outputs. Progress is real but far behind capability.

In practice: Identifying the internal features a model uses to represent a concept.