README.md

modelcar-catalog

The modelcar-catalog repo is designed to provide patterns for building ModelCar images for commonly used LLMs. Be sure to check out the modelcar-catalog registry to find many of these images pre-built and ready to use.

huggingface-modelcar-builder

The huggingface-modelcar-builder is a helper container designed to make it easier to pull models from huggingface to build a modelcar container.

Available Models

granite-3.0-2b-instruct

https://huggingface.co/ibm-granite/granite-3.0-2b-instruct

quay.io/redhat-ai-services/modelcar-catalog:granite-3.0-2b-instruct

granite-3.0-8b-instruct

https://huggingface.co/ibm-granite/granite-3.0-8b-instruct

quay.io/redhat-ai-services/modelcar-catalog:granite-3.0-8b-instruct

granite-3.1-2b-instruct

https://huggingface.co/ibm-granite/granite-3.1-2b-instruct

quay.io/redhat-ai-services/modelcar-catalog:granite-3.1-2b-instruct

granite-3.1-8b-instruct

https://huggingface.co/ibm-granite/granite-3.1-8b-instruct

quay.io/redhat-ai-services/modelcar-catalog:granite-3.1-8b-instruct

llama-3.2-1b-instruct

https://huggingface.co/ibm-granite/llama-3.2-1b-instruct

quay.io/redhat-ai-services/modelcar-catalog:llama-3.2-1b-instruct

mistral-7b-instruct-v0.3

https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3

quay.io/redhat-ai-services/modelcar-catalog:mistral-7b-instruct-v0.3

sparse-llama-3.1-8b-2of4

https://huggingface.co/ibm-granite/sparse-llama-3.1-8b-2of4

quay.io/redhat-ai-services/modelcar-catalog:sparse-llama-3.1-8b-2of4