Skip to content

server : remove legacy system_prompt feature #9857

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Merged
merged 3 commits into from
Oct 12, 2024

Conversation

ggerganov
Copy link
Member

@ggerganov ggerganov commented Oct 12, 2024

fix #9811

Not helpful anymore with the general availability of finetuned models that properly support system prompts via chat templates.

@ngxson
Copy link
Collaborator

ngxson commented Oct 12, 2024

Please note that in a recent PR, I moved the ability to change system_promptat runtime from POST /completions to POST /props

It is handle by handle_props_change. So I think for now we can remove handle_props_change.

@ggerganov
Copy link
Member Author

I think we can keep the /props endpoint as a placeholder in case we decide to add similar functionality in the future.

@ggerganov ggerganov merged commit 95c76e8 into master Oct 12, 2024
54 checks passed
@ggerganov ggerganov deleted the gg/server-remove-system-prompt branch October 12, 2024 11:51
drollings pushed a commit to drollings/llama.cpp that referenced this pull request Oct 18, 2024
* server : remove legacy system_prompt feature

ggml-ci

* readme : update [no ci]

* server : fix non-transformer logic + remove response from /props
dsx1986 pushed a commit to dsx1986/llama.cpp that referenced this pull request Oct 29, 2024
* server : remove legacy system_prompt feature

ggml-ci

* readme : update [no ci]

* server : fix non-transformer logic + remove response from /props
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Nov 15, 2024
* server : remove legacy system_prompt feature

ggml-ci

* readme : update [no ci]

* server : fix non-transformer logic + remove response from /props
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Nov 18, 2024
* server : remove legacy system_prompt feature

ggml-ci

* readme : update [no ci]

* server : fix non-transformer logic + remove response from /props
# for free to join this conversation on GitHub. Already have an account? # to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

server : remove system prompt support
3 participants