evaluators

package

v0.5.3 Latest Latest Go to latest Published: May 1, 2025 License: Apache-2.0 Imports: 10 Imported by: 0

Details

Package evaluators defines a set of Genkit Evaluators for popular use-cases

This section is empty.

This section is empty.

func ConfigureMetric(g *genkit.Genkit, metric MetricConfig) (ai.Evaluator, error)

type EvaluatorType int

EvaluatorType is an enum used to indicate the type of evaluator being configured for use

const (
	EvaluatorDeepEqual EvaluatorType = iota
	EvaluatorRegex
	EvaluatorJsonata
)

func (ss EvaluatorType) String() string

type GenkitEval struct {
	Metrics []MetricConfig // Configs for individual metrics
	// contains filtered or unexported fields
}

GenkitEval is a Genkit plugin that provides evaluators

func (ge *GenkitEval) Init(ctx context.Context, g *genkit.Genkit) (err error)

Init initializes the plugin.

func (ge *GenkitEval) Name() string

type MetricConfig struct {
	MetricType EvaluatorType
}

MetricConfig provides configuration options for a specific metric. More Params (judge LLMs, etc.) could be configured by extending this struct