Explainable UX
Synonyms: transparent AI, intelligible design, black box UX, interpretable UX, XUX, AI transparency design
Definition
Use cases
- Fintech approvals: Users denied a loan or credit increase become frustrated when the product gives no explanation. Showing key factors like credit utilization or missed payments gives users a clearer next step.
- Smart home systems: A thermostat suddenly lowering the temperature feels broken without context. A short explanation like “Energy-saving mode activated after 4 hours of inactivity” removes confusion.
- Streaming and recommendation feeds: Generic labels like “Recommended for you” feel weak when recommendations miss the mark. Context labels like “Because you watched…” help users understand the logic behind suggestions.
How it's used in practice
- Provide "because" statements: Use small UI labels (e.g., "Recommended because you watched...") to justify automated suggestions.
- Expose confidence levels: When using predictive text or data, show how certain the system is using visual indicators like percentages or progress bars.
- Design for recourse: Always provide a way for the user to "correct" the system if its explanation reveals a misunderstanding of their intent.
- Layered complexity: Use progressive disclosure; give a simple explanation up front, with a "Learn more" toggle for power users who want the technical details.
Challenges & limitations
- Some AI systems are difficult to explain: Complex machine learning models often produce outputs that even internal teams struggle to interpret clearly.
- Explanations can create false confidence: Poorly written explanations may make weak predictions sound more reliable than they actually are.
Free resources
- DARPA's XAI Program Overview: Foundational overview of explainable AI research and goals.
- LIME (Local Interpretable Model-Agnostic Explanations): While a technical tool, designers use LIME's "feature importance" maps to decide which data points should be visualized in the UI.
- Explainable AI in Chat Interfaces: Covers what works, what doesn't, and how UX teams can design AI explanations in real products.

