Manage criteria versions for Quality Evaluation Agent

Enabled for Public preview General availability
Users by admins, makers, or analysts - Feb 6, 2026

Business value

Quality Evaluation Agent criteria versioning allows supervisors to update and improve evaluation criteria while protecting ongoing customer engagement measurements. It enables teams to iterate, validate, and refine criteria without disrupting active quality runs, ensuring consistency, reliability, and operational continuity across the organization.

Feature details

Use built‑in versioning to edit, test, and publish evaluation criteria.

Quality Evaluation Agent criteria versioning enables supervisors to update evaluation criteria that are actively used to measure customer engagement quality. Each modification automatically generates a new version, ensuring that ongoing evaluations continue to run against the previously published version without interruption.

All versions are available in the evaluation criteria Versioning History tab, providing complete visibility into how the criteria have evolved. Supervisors can review earlier versions, restore any version to make it the current one, or discard draft updates as required.

To support informed publishing decisions, supervisors can run simulations on any criteria version to preview Quality Evaluation Agent generated outcomes. Simulation results remain visible only to the supervisor and aren't stored in customer engagement records or reflected in organizational quality scores. This allows teams to validate changes, fine‑tune instructions, and confirm expected behavior before releasing updated criteria for live evaluations.

Screenshot of versioning history

Geographic areas

Visit the Explore Feature Geography report for Microsoft Azure areas where this feature is planned or available.

Language availability

Visit the Explore Feature Language report for information on this feature's availability.

Manage evaluation criteria versions (docs)