Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

backend property in ai-lab.yaml file #758

Closed
axel7083 opened this issue Aug 14, 2024 · 0 comments · Fixed by #760
Closed

backend property in ai-lab.yaml file #758

axel7083 opened this issue Aug 14, 2024 · 0 comments · Fixed by #760

Comments

@axel7083
Copy link
Contributor

In the ai-lab.yaml files there a backend property which is not matching the backend property of the catalog in AI Lab. This field is llama for every recipe.

In whispercpp it is also llama (weird?)

In AI Lab we have a backend property for the catalog, defining for models and recipe which backend they need, the values allowed are llama-cpp, whisper-cpp and none see InferenceType for details

With the on-going work on AI Lab to make the recipes uses the existing InferenceServer instance, it would be better to unify those values to have them match

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant