---
title: "Scorecard — Context Infrastructure"
description: "Measure the layer and the outcome separately."
canonical: "https://press.getalchemystai.com/books/context-infrastructure-build-ai-that-understands-your-business/scorecard"
last_updated: "2018-10-20"
book: "Context Infrastructure"
label: "Chapter 27"
---

# Scorecard

Measure the layer and the outcome separately. Retrieval can be excellent while the business metric stays flat, and the reverse; you need both to know what to fix.

| Layer | Metric | What it tells you | Where it comes from |
| --- | --- | --- | --- |
| **Retrieval** | Share of test questions whose correct source reaches the window | Whether scoping and thresholds are right | Test set plus Context Traces |
| **Answers** | Supported-answer rate; correct "no evidence" responses | Whether the agent stays grounded | Test set, weekly trace sample |
| **Speed** | Retrieval latency at p50 and p95 | Headroom for real-time and voice use | Application telemetry |
| **Cost** | Tokens ingested and retrieved; model tokens per answer | Whether arithmetic is keeping prompts small | Usage dashboard |
| **Health** | Documents past their review date; 409 conflicts; tags added this month | Drift and taxonomy sprawl | Document view, logs |
| **Outcome** | The workflow's own KPI against its baseline | Whether any of it matters | The system of record |

Good outcome metrics are the ones the business already counts. The case studies use connection rate on retargeted cohorts, deliveries recovered before return-to-origin, renewals kept, NPS response rates, and recruiter or adviser hours returned.

---

- Previous: [Chapter 26: Who Does What](https://press.getalchemystai.com/books/context-infrastructure-build-ai-that-understands-your-business/who-does-what.md)
- Contents: [Context Infrastructure](https://press.getalchemystai.com/books/context-infrastructure-build-ai-that-understands-your-business.md)
- Next: [Chapter 28: How It Breaks](https://press.getalchemystai.com/books/context-infrastructure-build-ai-that-understands-your-business/how-it-breaks.md)
