Regression Gates and Release Criteria
Define release criteria such as minimum retrieval recall for critical sources, acceptable citation correctness, maximum unsupported-answer rate, latency SLO, and cost budget. Include security tests for cross-tenant access, injection, stale sources, and deletion. Maintain rollback for prompts, models, indexes, and settings.
After launch, monitor distribution shifts and update evaluation sets through review.
Implementation example
{
"minRecallAt5":0.90,
"minCitationSupport":0.95,
"maxP95LatencyMs":4000,
"securityChecksPassed":true
}💡 Values are illustrative; set thresholds from product risk and measured baseline.
Key Takeaways
- Inspect the relevant pipeline stage instead of guessing.
- Preserve source provenance, versions, and access scope.
- Measure quality on representative queries.
Knowledge Check
What is the purpose of an evaluation release gate?