Skip to content

OpenAI compatible response for /models has empty id and empty name #10924

Closed
@JeroenAdam

Description

@JeroenAdam

I have an issue with Open WebUI since b4276 which includes refactor #10643
Now the /api/models returns no id and name for the openai model so the UI cannot start any conversation with llama-server.

Old response (b4273):
{ "data": [ { "id": "Qwen2.5-Coder-32B-Instruct-IQ4_XS.gguf", "object": "model", "created": 1734734631, "owned_by": "openai", "meta": { "vocab_type": 2, "n_vocab": 152064, "n_ctx_train": 32768, "n_embd": 5120, "n_params": 32763876352, "size": 17687175168 }, "name": "Qwen2.5-Coder-32B-Instruct-IQ4_XS.gguf", "openai": { "id": "Qwen2.5-Coder-32B-Instruct-IQ4_XS.gguf", "object": "model", "created": 1734734631, "owned_by": "llamacpp", "meta": { "vocab_type": 2, "n_vocab": 152064, "n_ctx_train": 32768, "n_embd": 5120, "n_params": 32763876352, "size": 17687175168 } }, "urlIdx": 0, "actions": [] } ] }

New response since b4276:
{ "data": [ { "id": "", "object": "model", "created": 1734735053, "owned_by": "openai", "meta": { "vocab_type": 2, "n_vocab": 152064, "n_ctx_train": 32768, "n_embd": 5120, "n_params": 32763876352, "size": 17687175168 }, "name": "", "openai": { "id": "", "object": "model", "created": 1734735053, "owned_by": "llamacpp", "meta": { "vocab_type": 2, "n_vocab": 152064, "n_ctx_train": 32768, "n_embd": 5120, "n_params": 32763876352, "size": 17687175168 } }, "urlIdx": 0, "actions": [] } ] }

You see an empty id (2 times) and empty name

First Bad Commit

PR 10643 / b4276

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions