Validation

Trust comes from measurement. One ablation even showed direct SQL access didn't help — the bottleneck was structure, not access.

Aggregate accuracy95%
Adversarial review → accuracy+6%
Adversarial review → tokens+32%
Adversarial review → latency+72%
The cost of adversarial review
Accuracy gain: 66Accuracy gainExtra tokens: 3232Extra tokensExtra latency: 7272Extra latency
MethodWhat it doesType
Dashboard-based evalsAuto-generated, human-validated ground truthOffline
Long-tail evalsLLM-generated from business contextOffline
Ablation testingIsolate which component actually moves accuracyOffline
Adversarial reviewA second pass that critiques the answerOnline
Provenance footersShow data source tier and freshnessOnline
Correction harvestingTurn stakeholder fixes into automated PRsOnline

中文版