Skip to content

Conversation

@mudler
Copy link
Owner

@mudler mudler commented Dec 31, 2023

Description

This PR allows to start local-ai with a list of model config files URLs or our short-handed format (e.g. huggingface://. github://). It works by passing the urls as arguments or environment variable, for example:

local-ai github://owner/repo/file.yaml@branch

# Env
MODELS="github://owner/repo/file.yaml@branch,github://owner/repo/file.yaml@branch" local-ai

# Args
local-ai --models github://owner/repo/file.yaml@branch --models github://owner/repo/file.yaml@branch

For example, to start localai with phi-2, now it's possible for instance (config file from gists):

./local-ai https://gist.githubusercontent.com/mudler/ad601a0488b497b69ec549150d9edd18/raw/a8a8869ef1bb7e3830bf5c0bae29a0cce991ff8d/phi-2.yaml

The file should be a valid YAML configuration file. Note this works well with the last feature #1452. Note this is different from model galleries as that supports up to now also downloading multiple assets. This is for now an attempt to ease out the ux (see also #1373)

@netlify
Copy link

netlify bot commented Dec 31, 2023

Deploy Preview for localai canceled.

Name Link
🔨 Latest commit df1a461
🔍 Latest deploy log https://app.netlify.com/sites/localai/deploys/659279a343cd3300081e7f85
@mudler mudler added the enhancement New feature or request label Jan 1, 2024
@mudler mudler merged commit 66fa4f1 into master Jan 1, 2024
@mudler mudler deleted the share_models_by_url branch January 1, 2024 09:31
@mudler
Copy link
Owner Author

mudler commented Jan 2, 2024

to some extents this PR enhanced messages of model loading (see #1416)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

2 participants