Skip to content

Add RMS norm and use it #187

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Merged
merged 2 commits into from
Mar 15, 2023
Merged

Add RMS norm and use it #187

merged 2 commits into from
Mar 15, 2023

Conversation

hoangmit
Copy link
Contributor

To resolve issue #173

@hoangmit hoangmit changed the title Add Rms norm Add RMS norm and use it Mar 15, 2023
Copy link
Member

@ggerganov ggerganov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🦙

@ggerganov ggerganov merged commit 6eac39b into master Mar 15, 2023
@ggerganov ggerganov deleted the rms_norm branch March 15, 2023 22:42
blackhole89 pushed a commit that referenced this pull request Mar 15, 2023
* add ggml_rms_norm

* update op num
bitRAKE pushed a commit to bitRAKE/llama.cpp that referenced this pull request Mar 17, 2023
* add ggml_rms_norm

* update op num
Deadsg pushed a commit to Deadsg/llama.cpp that referenced this pull request Dec 19, 2023
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants