Type Alias EvaluatorOutputDefinition

EvaluatorOutputDefinition:
    | EvaluatorOutputDefinition.Numeric
    | EvaluatorOutputDefinition.Boolean
    | EvaluatorOutputDefinition.Categorical

Flat structured output definition used when creating or updating an evaluator.

dataType is required.
scoreReasoningInstructions and scoreValueInstructions are optional instructions.
minValue and maxValue apply only to NUMERIC outputs. If both are set, minValue must not exceed maxValue.
categories and shouldAllowMultipleMatches apply only to CATEGORICAL outputs.
Do not send version; that is an internal storage detail.

Example

{
 *         dataType: "NUMERIC",
 *         dataType: "NUMERIC",
 *         minValue: 0,
 *         maxValue: 1
 *     }

Example

{
 *         dataType: "BOOLEAN",
 *         dataType: "BOOLEAN",
 *         scoreValueInstructions: "Return true if the output satisfies the requirement, otherwise false."
 *     }

Example

{
 *         dataType: "CATEGORICAL",
 *         dataType: "CATEGORICAL",
 *         scoreReasoningInstructions: "Explain which category best fits the output.",
 *         scoreValueInstructions: "Choose the best category.",
 *         categories: ["correct", "partially_correct", "incorrect"],
 *         shouldAllowMultipleMatches: false
 *     }