增加aws bedrock Claude Cross-region模型支持 #416
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
增加aws bedrock Claude Cross-region模型支撑。
区域分割符改成`.`优雅一些。
去掉模型名称种的`anthropic`
|
THX~ |
# for free
to join this conversation on GitHub.
Already have an account?
# to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
增加aws bedrock Claude Cross-region模型支持。
参考资料：https://docs.aws.amazon.com/bedrock/latest/userguide/inference-profiles-support.html
实现和配置方式：
类似
US Anthropic Claude 3 Sonnet的Inference profile ID是us.anthropic.claude-3-sonnet-20240229-v1:0,后端做对应适配。在配置渠道模型的时候在原有模型名字前面以.分割增加区域标记us，即US Anthropic Claude 3 Sonnet的模型配置应该配置为us.claude-3-5-sonnet-20240620,如下图：如果需要用户请求claude-3-5-sonnet-20240620可以访问onehub的对应模型可以使用模型映射功能。
close #415
我已确认该 PR 已自测通过，相关截图如下：
