Skip to content

Make ordering of evaluation results deterministic #67

@sulekz

Description

@sulekz

When running the eval framework the order in which the queries are written into the final evaluation output is non-deterministic (I suspect this happens both in the VectaraConnector as well as the actual Evaluator). We should make this deterministic so the queries are always written in the same order in the output.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions