discussions Search Results · repo:Giskard-AI/giskard-oss language:JavaScript
Filter by
24 results
(89 ms)24 results
inGiskard-AI/giskard-oss (press backspace or delete to remove):
NotFoundError: litellm.NotFoundError: NotFoundError: OpenAIException - Error code: 404 - { error : { code : 404 ,
message : Resource not found }}
blacckbeard4posted
on Jun 20- 1
:
Hello, Im trying to evaluate a RAG Agent and all values of the resultant df in the correctness_reason column say the
exact same thing : The agent stated that they ship to United States, but should have ...
zeyadharounposted
on Aug 25- 2
:
Many models just train their data on benchmark questions and so if you choose those benchmark questions for -
performance testing then 7B and 14B thinking models can also compete in many questions against ...
Greatz08posted
on Apr 1- 0
:
when ı using this framework from giskard.rag import generate_testset, KnowledgeBase ı get ModuleNotFoundError: No module
named giskard.rag ; giskard is not a package this error.
klncgtyposted
on Jul 16, 2024- 6
:
Setting default threshold like 1 for accuracy test can have some limitation or risks.
On the risk side, a model with 100% accuracy is most likely a spurious one and the test would pass. Also, this make ...
AdriMarteauposted
on Jan 8, 2024- 2
:
Hi, When running a task with Giskard, the following warning is generated:
2024-11-07 15:35:25,209 pid:460389 MainThread giskard.rag INFO Finding topics in the knowledge base.
/envs/rag_test/lib/python3.9/site-packages/umap/umap_.py:2462: ...
gandrenacciposted
on Nov 7, 2024- 3
:
Hello,
If you can kindly help with the issue I am seeing. I am trying to evaluate my RAG application using giskard and
RAGAS,but on trying to do so I am getting the following error:
Giskard_Testing\giskard\rag\metrics\correctness.py ...
adhsayposted
on May 30, 2024- 13
:
I need to help how to view and debug logs - where would the log be for this type of error:
2024-08-20 11:58:45,954 pid:46739 MainThread httpx INFO HTTP Request: POST http://localhost:11434/v1/chat/completions ...
ClarkKentIsSupermanposted
on Aug 20, 2024- 13
:
Hello,
i have this basic code (mostly from the Giskard documentation):
import os
import giskard
import google.generativeai as genai
from giskard.llm.client.gemini import GeminiClient
import pandas ...
lanonseposted
on Sep 4, 2024- 1
:
How are the local datasets supposed to be downloaded? I was following some of the intro demos, and got an error saying
the prompt CSV wasn t found:
FileNotFoundError: [Errno 2] No such file or directory: ...
ClarkKentIsSupermanposted
on Aug 20, 2024- 3