ToolCallAccuracyEvaluatorContext.ToolDefinitions Property
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Gets set of tool definitions (see Tools) that were used when generating the model response that is being evaluated.
public:
property System::Collections::Generic::IReadOnlyList<Microsoft::Extensions::AI::AITool ^> ^ ToolDefinitions { System::Collections::Generic::IReadOnlyList<Microsoft::Extensions::AI::AITool ^> ^ get(); };public System.Collections.Generic.IReadOnlyList<Microsoft.Extensions.AI.AITool> ToolDefinitions { get; }member this.ToolDefinitions : System.Collections.Generic.IReadOnlyList<Microsoft.Extensions.AI.AITool>Public ReadOnly Property ToolDefinitions As IReadOnlyList(Of AITool)Property Value
Remarks
ToolCallAccuracyEvaluator measures how accurately an AI system uses tools by examining tool calls (i.e., FunctionCallContents) present in the supplied response to assess the relevance of these tool calls to the conversation, the parameter correctness for these tool calls with regard to the tool definitions supplied via ToolDefinitions, and the accuracy of the parameter value extraction from the supplied conversation history.
Note that at the moment, ToolCallAccuracyEvaluator only supports evaluating calls to tools that are defined as AIFunctions. Any other AITool definitions that are supplied via ToolDefinitions will be ignored.
