Skip to content

discussions Search Results · repo:Giskard-AI/giskard-oss language:JavaScript

24 results
 (89 ms)

24 results

inGiskard-AI/giskard-oss (press backspace or delete to remove)

NotFoundError: litellm.NotFoundError: NotFoundError: OpenAIException - Error code: 404 - { error : { code : 404 , message : Resource not found }}

Hello, Im trying to evaluate a RAG Agent and all values of the resultant df in the correctness_reason column say the exact same thing : The agent stated that they ship to United States, but should have ...

Many models just train their data on benchmark questions and so if you choose those benchmark questions for - performance testing then 7B and 14B thinking models can also compete in many questions against ...

when ı using this framework from giskard.rag import generate_testset, KnowledgeBase ı get ModuleNotFoundError: No module named giskard.rag ; giskard is not a package this error.

Setting default threshold like 1 for accuracy test can have some limitation or risks. On the risk side, a model with 100% accuracy is most likely a spurious one and the test would pass. Also, this make ...

Hi, When running a task with Giskard, the following warning is generated: 2024-11-07 15:35:25,209 pid:460389 MainThread giskard.rag INFO Finding topics in the knowledge base. /envs/rag_test/lib/python3.9/site-packages/umap/umap_.py:2462: ...

Hello, If you can kindly help with the issue I am seeing. I am trying to evaluate my RAG application using giskard and RAGAS,but on trying to do so I am getting the following error: Giskard_Testing\giskard\rag\metrics\correctness.py ...
  • adhsayposted
    on May 30, 2024
  • 13

I need to help how to view and debug logs - where would the log be for this type of error: 2024-08-20 11:58:45,954 pid:46739 MainThread httpx INFO HTTP Request: POST http://localhost:11434/v1/chat/completions ...

Hello, i have this basic code (mostly from the Giskard documentation): import os import giskard import google.generativeai as genai from giskard.llm.client.gemini import GeminiClient import pandas ...

How are the local datasets supposed to be downloaded? I was following some of the intro demos, and got an error saying the prompt CSV wasn t found: FileNotFoundError: [Errno 2] No such file or directory: ...