Skip to content

feature: Chat completion functions #588

Closed

Description

@mudler

Have a feature that mimics OpenAI functions: https://openai.com/blog/function-calling-and-other-api-updates.

From the documentation, it seems OpenAI trained the model to respond to the system prompt.

For LocalAI, I think there should be a minimum viable implementation that should work across models. While custom models could be trained to reflect a specific prompt that is injected, that would limit this functionalities to restricted models.

Activity

  1. self-assigned this
    on Jun 13, 2023
  2. mudler commented on Jun 15, 2023

    @mudler
    OwnerAuthor

    likely depending on #354

  3. mudler commented on Jul 2, 2023

    @mudler
    OwnerAuthor

    I've posted my updates on the upstream PR: ggml-org/llama.cpp#1773 (comment) to give early feedback on the feature

    This depends on: ggml-org/llama.cpp#1773

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions