You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
From the documentation, it seems OpenAI trained the model to respond to the system prompt.
For LocalAI, I think there should be a minimum viable implementation that should work across models. While custom models could be trained to reflect a specific prompt that is injected, that would limit this functionalities to restricted models.
Activity
mudler commentedon Jun 15, 2023
likely depending on #354
mudler commentedon Jul 2, 2023
I've posted my updates on the upstream PR: ggml-org/llama.cpp#1773 (comment) to give early feedback on the feature
This depends on: ggml-org/llama.cpp#1773