Skip to content

Commit

Permalink
Mention the need to request access to Llama models in 2025-01-27-intr…
Browse files Browse the repository at this point in the history
…o-to-llama-stack-with-vllm.md (#23)
  • Loading branch information
terrytangyuan authored Feb 6, 2025
1 parent 55403d3 commit 3d55f5c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion _posts/2025-01-27-intro-to-llama-stack-with-vllm.md
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ In this article, we will demonstrate the functionality through the remote vLLM i

### Start vLLM Server

We first download the "Llama-3.2-1B-Instruct" model using the [Hugging Face CLI](https://huggingface.co/docs/huggingface_hub/main/en/guides/cli). Note that you'll need to specify your Hugging Face token when logging in.
We first download the "Llama-3.2-1B-Instruct" model using the [Hugging Face CLI](https://huggingface.co/docs/huggingface_hub/main/en/guides/cli). Note that you'll need to [request for access](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct) and then specify your Hugging Face token when logging in.

```bash
mkdir /tmp/test-vllm-llama-stack
Expand Down

0 comments on commit 3d55f5c

Please # to comment.