Precision vs. Recall
Synonyms: false positives vs. false negatives, precision-recall tradeoff, hit rate vs. coverage, exactness vs. completeness
Definition
Use cases
- Spam filter, too much recall: It catches every spam message but also flags real emails. Users miss an invoice or a job offer and stop trusting the inbox.
- Fraud check, too much precision: It almost never false-alarms, so it feels clean, but it misses real fraud and the company loses money.
- Search and recommendations: High recall returns everything loosely related and buries the good results in noise. High precision returns a few exact matches but skips options the user wanted.
How it's used in practice
- Decide which error costs more: For this feature, is a false alarm or a miss worse? Set the threshold toward the side you can least afford to get wrong.
- Design for the error you chose: If you favor recall, make "not spam" recovery one tap. If you favor precision, give users a clear "report a miss" path.
- Show the tradeoff with real numbers: Bring stakeholders precision and recall separately, not a single accuracy figure that hides the choice.
- Make the threshold context-aware: Let high-stakes flows lean toward catching everything and low-stakes flows lean toward staying quiet.
Challenges & limitations
- You can't max both: Improving precision usually costs recall and the other way around. There's no setting that wins on both at once.
- The right balance shifts: What's correct depends on context and changes as usage and stakes change, so it needs revisiting.
Free resources
- Evidently AI: Accuracy vs. Precision vs. Recall — an illustrated explainer using a churn example, with clear guidance on choosing a metric by error cost.
- Recall vs Precision in an AI Product or Feature (Matt Szaszko, Medium) — frames the precision-recall choice as a product and UX decision driven by risk, with low- vs high-risk examples and a Google Photos walkthrough (People tab, NLP search) arguing the balance should shift by feature and available data.

