Skip to content

Issues: lucidrains/x-transformers

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

59 Open 177 Closed
59 Open 177 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

torch.compile support
#304 opened Dec 18, 2024 by theolundqvist
[Feature request] Efficient stochastic path without unused layers
#294 opened Nov 18, 2024 by Aceticia
6
Support for a mask during autoregressive generation with Key-Value Caching
#292 opened Nov 12, 2024 by Oufattole
10
Is ContinuousTransformerWrapper needed?
#284 opened Oct 28, 2024 by mpeven
2
paper for GLU Mult Bias?
#275 opened Oct 4, 2024 by TimS-ml
3
Small paper ideas to be added
#262 opened Jul 25, 2024 by RyanKim17920
6
[Question] Why is RotaryEmbedding not used when cross attending?
#258 opened Jul 11, 2024 by pfeatherstone
1
Confusion about image->caption example
#239 opened Feb 9, 2024 by mtran14
1
Generation for PaLI?
#238 opened Feb 5, 2024 by BurgerAndreas
[Minor; noob question] Uniform distribution instead of normal
#232 opened Jan 21, 2024 by p0p4k
1
how to set inputs to the right shape
#218 opened Dec 17, 2023 by emadkavousi
1
ONNX export failed
#212 opened Nov 27, 2023 by pfeatherstone
14
Question: masking in token shifting
#208 opened Nov 24, 2023 by pfeatherstone
1
Feature request: different normalization layers at different depths
#199 opened Oct 24, 2023 by pfeatherstone
High memory usage compared to Huggingface and Autocast has no effect?
#197 opened Oct 21, 2023 by LarsHill
3
Feature request: add local and reformer
#188 opened Sep 26, 2023 by samvanstroud
1
Idea: hyperparameter searching
#181 opened Aug 31, 2023 by pfeatherstone
2
Torchsummary not working
#180 opened Aug 29, 2023 by avocardio
Feature request: don't specify attn_flash. Select when possible
#173 opened Aug 9, 2023 by pfeatherstone
2
Back-propagation on Mask for attention layers
#168 opened Jul 17, 2023 by gaasher
1
Feature request: support return_mems in ContinuousTransformerWrapper
#166 opened Jul 17, 2023 by pfeatherstone
16
GPT training problem
#162 opened Jul 10, 2023 by phuvinhnguyen
How to use the rope scaling with x_transformers ?
#159 opened Jun 29, 2023 by cutoken
21
Any plans to make a jax iteration of this repository? We really need it
#157 opened Jun 15, 2023 by kyegomez
1
ALiBi: buffered bias slicing gets confusing when i != j
#153 opened Jun 1, 2023 by antony-frolov
ProTip! Mix and match filters to narrow down what you’re looking for.