Humanized Conversation API (using LLM)
proportional conversation in a human way without exposing that you are an LLM answering
To use the project, you need to have the .csv file with the knowledge base and the .toml file with the prompt configuration.
fields:
- category
- subcategory: used to customize the prompt for specific questions
- question
- content: used to generate the embeding
example:
category,subcategory,question,content
faq,promotions,loyalty-program,"The company XYZ has a loyalty program when you refer new customers you get a discount on your next purchase, ..."
The [prompt.header] and [prompt.suggested] fields are mandatory fields used for processing the conversation and connecting to LLM.
It is also possible to add information to the prompt for subcategories, see below for an example of a complete configuration:
[prompt]
header = """You are a service operator called Avelino from XYZ, you are an expert in providing
qualified service to high-end customers. Be brief in your answers, without being long-winded
and objective in your responses. Never say that you are a model (AI), always answer as Avelino.
Be polite and friendly!"""
suggested = "Here is some possible content that could help the user in a better way."
[prompt.subcategory.loyalty-program]
header = """The client is interested in the loyalty program, and needs to be responded to in a
salesy way; the loyalty program is our growth strategy."""Look at the .env.example file to see the environment variables needed to run the project.
we assume you are familiar with Docker
cp .env.example .env # edit the .env file, add the OPENAI token and the path to the .csv and .toml files
docker compose upAfter uploading the project, go to the documentation http://localhost:8000/docs to see the API documentation.
We've used python and bundled packages with poetry, now it's up to you - Makefile can help.