Uncertainty highlighting | G2: Make clear how well the system can do what it can do

blue header bar

Highlighting tokens with low generation probabilities (Spatharioti et al., 2023) sets expectations for how well the system can do what it can do (Guideline 2) by using visual cues to convey uncertainty in AI outputs.

The techniques used in this example have the potential to foster appropriate reliance on AI, by reducing overreliance. Keep in mind that overreliance mitigations can backfire. Be sure to test such mitigations in context, with your AI system’s actual users. Learn more about overreliance on AI and appropriate reliance on generative AI.

Image captured in February 2024.