TaskAdherenceEvaluatorContext.ToolDefinitions Property
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Gets set of tool definitions (see Tools) that were used when generating the model response that is being evaluated.
public:
property System::Collections::Generic::IReadOnlyList<Microsoft::Extensions::AI::AITool ^> ^ ToolDefinitions { System::Collections::Generic::IReadOnlyList<Microsoft::Extensions::AI::AITool ^> ^ get(); };public System.Collections.Generic.IReadOnlyList<Microsoft.Extensions.AI.AITool> ToolDefinitions { get; }member this.ToolDefinitions : System.Collections.Generic.IReadOnlyList<Microsoft.Extensions.AI.AITool>Public ReadOnly Property ToolDefinitions As IReadOnlyList(Of AITool)Property Value
Remarks
TaskAdherenceEvaluator measures how accurately an AI system adheres to the task assigned to it by examining the alignment of the supplied response with instructions and definitions present in the conversation history, the accuracy and clarity of the response, and the proper use of tool definitions supplied via ToolDefinitions.
Note that at the moment, TaskAdherenceEvaluator only supports evaluating calls to tools that are defined as AIFunctions. Any other AITool definitions that are supplied via ToolDefinitions will be ignored.
