77 questions
-1
votes
1
answer
63
views
module not found in haystack 2.17.1
i am trying to create a small starter llm RAG project using haystack. my project packages are below (I use UV):
[project]
name = "llm-project"
version = "0.1.0"
description = "...
- 982
0
votes
2
answers
84
views
How to combine multiple chatbot pipelines into 1 big pipeline using Haystack 2.X?
So in the past couple of months, I have created several chatbot pipelines using haystack 2.X. Here are a couple of chatbots that I have created:
Chatbot with RAG Documents from the database, with ...
- 47
-1
votes
1
answer
100
views
How to add function tools in the haystack pipeline?
I just started learning to create a chatbot using Haystack. Previously I was using Haystack 2.6 and just upgraded to 2.12.
Then I just compiled, copied, and tried all the codes that I found so they ...
- 47
0
votes
2
answers
194
views
How to include image as part of user prompt in haystack 2.X?
I have a great pipeline of chatbot using Haystack. I am referring to the haystack docs to create a pipeline, here is the example of the pipeline using prompt builder:
from haystack import Pipeline
...
- 47
-2
votes
1
answer
111
views
Python Farm-haystack Dependencies
i am trying to implement a model using farm-haystack, however am having a dependency mismatch for the following libraries : transformers farm-haystack langchain pydantic fastapi uvicorn elasticsearch ...
- 1
0
votes
0
answers
265
views
How to get bounding boxes (BBox) for chunks in a RAG Pipeline to highlight top 5 retrieved chunks in a PDF document?
I'm working on a RAG (retrieval-augmented generation) pipeline, where I first preprocess a PDF document and split it into chunks. When running the RAG process, I retrieve the top 5 chunks and generate ...
0
votes
1
answer
69
views
How to create a Natural Language Inference pipeline in Haystack
I want to use the Haystack framework to create a pipeline for Natural Language Inference on the response from a Retrieval-Augmented Generation (RAG) application
Because I'm using haystack-ai , I ...
- 2,769
0
votes
1
answer
62
views
Haystack 2 with Elasticsearch complex document
I have Elasticsearch storage with a movies index which is populated with documents like that:
{
_id: ObjectId,
title: "Some film",
actors: [ { _id: ObjectId, title: "Actor A" ...
- 414
0
votes
0
answers
316
views
Haystack PipelineConnectError: Cannot connect 'replies_to_query.output' with 'bm25_retriever.query'
I am new to the haystack framework and their pipelines. I am very convinced about the logic of the structure of the pipes but the error messages are still quite cryptic to me. I am trying to run a ...
- 105
0
votes
1
answer
67
views
Deepsetai: Haystack Meta data filtering on arrays
When using a Document Retriever with Haystack, you can filter the meta data.
A very important operator is the "in" operator, which allows you to check if one of the values specified in your ...
- 135
1
vote
0
answers
63
views
Duplicate Collection error with Melvis and Haystack
I am using Milvus as document store with Haystack.
MilvusDocumentStore connection object called with:
@lru_cache
def get_vector_db():
# Get document store from database
return ...
- 2,377
0
votes
1
answer
242
views
How to index 1000 .py files in multiple subdirectories to a vector database & make RAG leverage the folder structure?
There 1000s of .py files from 20 different projects. The directory structure is as follows
code base root folder
* common libaries1
* common libaries2
* common libaries3
* project1
* project2
* ...
- 8,944
0
votes
1
answer
93
views
Install local version of Haystack's Annotation Tool
Although the instructions in Haystack describe how to install the annotation tool locally using Docker, all attempts have failed. Unfortunately, the website does not contain any more details.
Has ...
- 3,286
0
votes
1
answer
160
views
Model generator is loading on only one GPU causing a CUDA out of memory error
I'm running a LLM code on 8 Nvidia A100 GPUs (1 node).
When I'm trying to load a big model (70B), I get a CUDA out of memory error.
from haystack.components.generators import ...
- 512
0
votes
0
answers
169
views
RAG with Haystack: compiles but returns empty responses
My RAG pipeline (using Haystack) compiles and runs, but is returning empty responses.
From my checks, I thought it might be due to the embedding and llm models not being compatible, so I changed to an ...
- 512