From the course: Build with AI: Create Custom Chatbots with n8n
Join today to access over 25,600 courses taught by industry experts.
Securing and scaling your chatbot
From the course: Build with AI: Create Custom Chatbots with n8n
Securing and scaling your chatbot
- [Instructor] When deploying LLMs in production, it's not just about making them work, it's about making them work securely at scale. Let's see what that means concretely. LLMs are powerful, but they can also be costly to run, especially if they're receiving a lot of requests with a lot of context. Also, there are many stories of chatbots that leaked internal information, provided wrong responses, or could be tricked into emulating a different persona. We don't want this to happen to you, so let's take a look at some key security and scaling paradigms. First, security. There are three key areas to secure. The first is to control what gets sent to the LLM. Filter or sanitize inputs in n8n. Strip away unsafe or irrelevant content. One way to do this in n8n is to implement a security gateway that sits between the chat input and your chat LLM. This gateway ensures that the chatbot only sees user messages that are not harmful or manipulative, including filtering out prompt injections…
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.