Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

feat: share models by url #1522

Merged
merged 6 commits into from
Jan 1, 2024
Merged

feat: share models by url #1522

merged 6 commits into from
Jan 1, 2024

Conversation

mudler
Copy link
Owner

@mudler mudler commented Dec 31, 2023

Description

This PR allows to start local-ai with a list of model config files URLs or our short-handed format (e.g. huggingface://. github://). It works by passing the urls as arguments or environment variable, for example:

local-ai github://owner/repo/file.yaml@branch

# Env
MODELS="github://owner/repo/file.yaml@branch,github://owner/repo/file.yaml@branch" local-ai

# Args
local-ai --models github://owner/repo/file.yaml@branch --models github://owner/repo/file.yaml@branch

For example, to start localai with phi-2, now it's possible for instance (config file from gists):

./local-ai https://gist.githubusercontent.com/mudler/ad601a0488b497b69ec549150d9edd18/raw/a8a8869ef1bb7e3830bf5c0bae29a0cce991ff8d/phi-2.yaml

The file should be a valid YAML configuration file. Note this works well with the last feature #1452. Note this is different from model galleries as that supports up to now also downloading multiple assets. This is for now an attempt to ease out the ux (see also #1373)

Copy link

netlify bot commented Dec 31, 2023

Deploy Preview for localai canceled.

Name Link
🔨 Latest commit df1a461
🔍 Latest deploy log https://app.netlify.com/sites/localai/deploys/659279a343cd3300081e7f85

@mudler mudler added the enhancement New feature or request label Jan 1, 2024
@mudler mudler merged commit 66fa4f1 into master Jan 1, 2024
@mudler mudler deleted the share_models_by_url branch January 1, 2024 09:31
@mudler
Copy link
Owner Author

mudler commented Jan 2, 2024

to some extents this PR enhanced messages of model loading (see #1416)

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant