You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
-**setup**: Indexes the default PDF document (`docs/cat-handbook.pdf`) into the vector store
19
+
-**pdf_qa**: RAG flow that answers questions based on indexed PDF documents. It requires `setup` flow run first.
20
+
-**index_pdf**: Indexes a specified PDF file (defaults to `docs/cat-wiki.pdf`)
21
+
-**simple_structured**: Simple flow with structured input/output
22
+
-**simple_echo**: Simple echo flow
23
+
-**dog_facts_eval**: Programmatic evaluation flow using the faithfulness metric on a dog facts dataset. **Note:** This flow can take several minutes to complete.
The `dog_facts_eval` flow demonstrates running evaluations from code. See `src/eval_in_code.py` for implementation details.
63
-
64
-
```bash
65
-
# Run programmatic evaluation
66
-
genkit flow:run dog_facts_eval
67
-
```
68
-
69
-
**Note:** The `dog_facts_eval` flow evaluates 20 test cases with the faithfulness metric, making 40 LLM API calls. This takes approximately 5 minutes to complete.
70
-
71
-
## Available Flows
72
-
73
-
-**setup**: Indexes the default PDF document (`docs/cat-handbook.pdf`) into the vector store
74
-
-**index_pdf**: Indexes a specified PDF file (defaults to `docs/cat-wiki.pdf`)
75
-
-**pdf_qa**: RAG flow that answers questions based on indexed PDF documents. It requires `setup` flow run first.
76
-
-**simple_structured**: Simple flow with structured input/output
77
-
-**simple_echo**: Simple echo flow
78
-
-**dog_facts_eval**: Programmatic evaluation flow using the faithfulness metric on a dog facts dataset
79
-
80
40
## Reference
81
41
82
42
For more details on using Genkit evaluations, please refer to the official [Genkit documentation](https://firebase.google.com/docs/genkit/evaluation).
0 commit comments