Inventory sources
Build a source catalog with ownership, update cadence, permissions, and data criticality.
Deliverables
- Source inventory
- Permission map
- Criticality scoring
Guide
Retrieval hardening
Improve source quality, freshness, and citation confidence before broad rollout.
Target outcomes
Conditions that should be true before expanding this workflow in production.
Guide
Source freshness tracked as an SLO by source class.
Guide
Citation confidence exposed in review and ops dashboards.
Guide
Drift monitoring alerts operationalized before scale-up.
Execution stages
Each stage produces operational artifacts that client teams can review and run.
Define freshness SLOs
Set freshness targets per source class and business use case.
Deliverables
- Freshness SLO table
- Ingestion failure thresholds
- Alert routing
Stress-test citations
Probe citation coverage on edge prompts and low-context requests.
Deliverables
- Adversarial prompt set
- Citation quality rubric
- Reviewer calibration notes
Monitor drift
Track retrieval drift and source regressions with escalation automation.
Deliverables
- Drift dashboard
- Incident runbook
- Weekly retrieval review ritual
Recommended resources
Learn references that support this playbook in delivery.
Report
Linked operations report
Snapshot view used to track progress and health for this playbook.
Support workflow report
Operational view focused on support throughput, escalation pressure, and queue quality.
- Escalation rate vs resolved throughput.
- Queue delay risk by status bucket.
- Priority mix and response ownership gaps.
Related routes