Skip to content

Commit 6bbeea0

Browse files
authored
README.md multimodal params fix (ggml-org#967)
multi modal params fix: add logits = True -> to make llava work
1 parent c1d92ce commit 6bbeea0

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

Diff for: README.md

+2-1
Original file line numberDiff line numberDiff line change
@@ -266,7 +266,8 @@ Then you'll need to use a custom chat handler to load the clip model and process
266266
>>> llm = Llama(
267267
model_path="./path/to/llava/llama-model.gguf",
268268
chat_handler=chat_handler,
269-
n_ctx=2048 # n_ctx should be increased to accomodate the image embedding
269+
n_ctx=2048, # n_ctx should be increased to accomodate the image embedding
270+
logits_all=True,# needed to make llava work
270271
)
271272
>>> llm.create_chat_completion(
272273
messages = [

0 commit comments

Comments
 (0)