Skip to content

PyTorch implementation of Rotary Position Embedding(RoPE).

License

Notifications You must be signed in to change notification settings

Yuan-ManX/RoPE-PyTorch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

RoPE PyTorch

RoPE

PyTorch implementation of Rotary Position Embedding(RoPE).

Rotary Position Embedding(RoPE) - RoFormer: Enhanced Transformer with Rotary Position Embedding.

About

PyTorch implementation of Rotary Position Embedding(RoPE).

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages