Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[LLM INFER] add rope_theta for block_multihead_attention #9334

Merged
merged 3 commits into from
Oct 29, 2024

Conversation

yuanlehome
Copy link
Collaborator

PR types

Bug fixes

PR changes

Others

Description

Fix for PaddlePaddle/Paddle#68573

Copy link

paddle-bot bot commented Oct 29, 2024

Thanks for your contribution!

Copy link

codecov bot commented Oct 29, 2024

Codecov Report

Attention: Patch coverage is 0% with 1 line in your changes missing coverage. Please review.

Please upload report for BASE (develop@975d5c7). Learn more about missing BASE report.
Report is 251 commits behind head on develop.

Files with missing lines Patch % Lines
...erimental/transformers/fused_transformer_layers.py 0.00% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             develop    #9334   +/-   ##
==========================================
  Coverage           ?   52.73%           
==========================================
  Files              ?      669           
  Lines              ?   107245           
  Branches           ?        0           
==========================================
  Hits               ?    56560           
  Misses             ?    50685           
  Partials           ?        0           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Collaborator

@ZHUI ZHUI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ZHUI ZHUI merged commit f0aa672 into PaddlePaddle:develop Oct 29, 2024
8 of 12 checks passed
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants