You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In the ai-lab.yaml files there a backend property which is not matching the backend property of the catalog in AI Lab. This field is llama for every recipe.
In AI Lab we have a backend property for the catalog, defining for models and recipe which backend they need, the values allowed are llama-cpp, whisper-cpp and none see InferenceType for details
With the on-going work on AI Lab to make the recipes uses the existing InferenceServer instance, it would be better to unify those values to have them match
The text was updated successfully, but these errors were encountered:
In the
ai-lab.yaml
files there abackend
property which is not matching the backend property of the catalog in AI Lab. This field isllama
for every recipe.ai-lab-recipes/recipes/natural_language_processing/rag/ai-lab.yaml
Lines 11 to 12 in 5db0a4d
In whispercpp it is also llama (weird?)
ai-lab-recipes/recipes/audio/audio_to_text/ai-lab.yaml
Lines 11 to 12 in 8b5adaa
In AI Lab we have a backend property for the catalog, defining for models and recipe which backend they need, the values allowed are
llama-cpp
,whisper-cpp
andnone
see InferenceType for detailsWith the on-going work on AI Lab to make the recipes uses the existing InferenceServer instance, it would be better to unify those values to have them match
The text was updated successfully, but these errors were encountered: