Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

feat: add session/prefix cache for doubao #2027

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

laoshancun
Copy link

close #2026
测试镜像:hualv/one-api:v0.6.11-alpha.1
我已确认该 PR 已自测通过,相关截图如下:

image

@songquanpeng
Copy link
Owner

请问这个 cache 是干嘛的,有相关的文档描述吗?

@laoshancun
Copy link
Author

laoshancun commented Feb 5, 2025

请问这个 cache 是干嘛的,有相关的文档描述吗?

#2026 中有描述,能降低80%左右调用成本。

前缀缓存
Session 缓存

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

功能请求:支持豆包前缀缓存和会话缓存
2 participants