TaskAdherenceEvaluatorContext Class

Definition

Namespace:: Microsoft.Extensions.AI.Evaluation.Quality

Assembly:: Microsoft.Extensions.AI.Evaluation.Quality.dll

Package:: Microsoft.Extensions.AI.Evaluation.Quality v9.7.0

Source:: TaskAdherenceEvaluatorContext.cs

Important

Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.

Contextual information that the TaskAdherenceEvaluator uses to evaluate an AI system's effectiveness at adhering to the task assigned to it.

public ref class TaskAdherenceEvaluatorContext sealed : Microsoft::Extensions::AI::Evaluation::EvaluationContext

[System.Diagnostics.CodeAnalysis.Experimental("AIEVAL001")]
public sealed class TaskAdherenceEvaluatorContext : Microsoft.Extensions.AI.Evaluation.EvaluationContext

public sealed class TaskAdherenceEvaluatorContext : Microsoft.Extensions.AI.Evaluation.EvaluationContext

[<System.Diagnostics.CodeAnalysis.Experimental("AIEVAL001")>]
type TaskAdherenceEvaluatorContext = class
    inherit EvaluationContext

type TaskAdherenceEvaluatorContext = class
    inherit EvaluationContext

Public NotInheritable Class TaskAdherenceEvaluatorContext
Inherits EvaluationContext

Inheritance: Object

EvaluationContext
TaskAdherenceEvaluatorContext

Attributes: ExperimentalAttribute

Remarks

TaskAdherenceEvaluator measures how accurately an AI system adheres to the task assigned to it by examining the alignment of the supplied response with instructions and definitions present in the conversation history, the accuracy and clarity of the response, and the proper use of tool definitions supplied via ToolDefinitions.

Note that at the moment, TaskAdherenceEvaluator only supports evaluating calls to tools that are defined as AIFunctions. Any other AITool definitions that are supplied via ToolDefinitions will be ignored.

Constructors

TaskAdherenceEvaluatorContext(AITool[])	Initializes a new instance of the TaskAdherenceEvaluatorContext class.
TaskAdherenceEvaluatorContext(IEnumerable<AITool>)	Initializes a new instance of the TaskAdherenceEvaluatorContext class.

Properties

Contents	Gets or sets a list of AIContent objects that include all the information present in this EvaluationContext. (Inherited from EvaluationContext)
Name	Gets or sets the name for this EvaluationContext. (Inherited from EvaluationContext)
ToolDefinitions	Gets set of tool definitions (see Tools) that were used when generating the model response that is being evaluated.
ToolDefinitionsContextName	Gets the unique Name that is used for TaskAdherenceEvaluatorContext.

Applies to