Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch
-
Updated
Jul 1, 2025 - Python
#
positional-encoding
Here are 33 public repositories matching this topic...
PET-NeuS: Positional Encoding Tri-Planes for Neural Surfaces (CVPR 2023)
pytorch surface-reconstruction nerf implicit-surfaces positional-encoding multi-view-reconstruction cvpr2023 tri-planes
-
Updated
May 2, 2024 - Python
Source code for GNN-LSPE (Graph Neural Networks with Learnable Structural and Positional Representations), ICLR 2022
graphs transformers attention representation-learning molecules message-passing lspe geometric-deep-learning graph-neural-networks graph-representation-learning gnn graph-deep-learning positional-encoding graph-transformer transformer-networks gnn-lspe
-
Updated
Feb 10, 2022 - Python
[CVPR 2021] Adversarial Generation of Continuous Images
-
Updated
Nov 10, 2021 - Python
[CVPR 2023] This is the official PyTorch implementation for "Dynamic Focus-aware Positional Queries for Semantic Segmentation".
-
Updated
Mar 4, 2023 - Python
Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding
deep-neural-networks deep-learning pytorch transformer deeplearning attention-is-all-you-need positional-encoding
-
Updated
Sep 30, 2024 - Python
Continuous Augmented Positional Embeddings (CAPE) implementation for PyTorch
audio text speech pytorch transformer vit cape positional-encoder positional-encoding visual-transformer positional-embedding
-
Updated
Dec 28, 2022 - Python
"Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding" Zhenyu Zhang, Runjin Chen, Shiwei Liu, Zhewei Yao, Olatunji Ruwase, Beidi Chen, Xiaoxia Wu, Zhangyang Wang.
-
Updated
May 7, 2024 - Python
Multiresolution Graph Transformers and Wavelet Positional Encoding for Learning Long-Range and Hierarchical Structures
density-functional-theory wavelet-transform graph-neural-networks positional-encoding graph-transformer
-
Updated
Oct 27, 2023 - Python
Context-aware Biases for Length Extrapolation
auto-regressive-model gpt context-aware cable rope alibi positional-encoding large-language-models llm length-extrapolation
-
Updated
May 24, 2025 - Python
PyTorch implementation of "Attention Is All You Need" by Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin
-
Updated
Aug 26, 2023 - Python
🧮 Algebraic Positional Encodings.
-
Updated
Jan 9, 2025 - Python
完整的原版transformer程序，complete origin transformer program
-
Updated
Mar 5, 2025 - Python
Unofficial pytorch implementation of the paper "Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding", NeurIPS 2021.
-
Updated
Apr 24, 2024 - Python
Implementation of Rotary Embeddings, from the Roformer paper, in Tensorflow
-
Updated
Sep 12, 2021 - Python
[ICML'25] "Rethinking Addressing in Language Models via Contextualized Equivariant Positional Encoding" by Jiajun Zhu, Peihao Wang, Ruisi Cai, Jason D. Lee, Pan Li, Zhangyang Wang
-
Updated
Jun 6, 2025 - Python
The implementation of transformer as presented in the paper "Attention is all you need" from scratch.
transformers attention-mechanism attention-is-all-you-need multihead-attention self-attention positional-encoding
-
Updated
Mar 4, 2023 - Python
Benchmarking Positional Encodings for GNNs and Graph Transformers
-
Updated
Jan 26, 2025 - Python
Official code for NeurIPS 2023 paper "Laplacian Canonization: A Minimalist Approach to Sign and Basis Invariant Spectral Embedding".
-
Updated
Jan 20, 2024 - Python
Application for training an autoencoder for generating an encoder that can be used as feature extractor for dimensionality and noise reduction, while the decoder can be used for synthetic data generation. Supports dynamic plugin integration, allowing users to extend its capabilities by adding custom encoder and decoder models.
machine-learning tensorflow keras transformers cnn lstm autoencoder vae dimensionality-reduction pretrained-models ann attention-mechanism plugin-system cnn-keras reusable-components pretrained-weights synthetic-data pretraining positional-encoding
-
Updated
Jun 21, 2025 - Python
Improve this page
Add a description, image, and links to the positional-encoding topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the positional-encoding topic, visit your repo's landing page and select "manage topics."