Skip to content

Issues: glample/fastBPE

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

35 Open 24 Closed
35 Open 24 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

fastBPE will not install on windows 11 or WSL
#64 opened Jun 5, 2024 by Otto-V-Bismarck
3
terminate called after throwing an instance of 'c10::Error' what(): [enforce fail at inline_container.cc:319] . unexpected pos 2302963008 vs 2302962896 frame #0: c10::ThrowEnforceNotMet(char const*, int, char const*, std::string const&, void const*) + 0x55 (0x15158b1320a5 in /usr/local/lib/python3.8/dist-packages/torch/lib/libc10.so)
#63 opened Apr 20, 2024 by lldd1001
Fails to build on Python 3.11 - longintrepr.h: No such file or directory
#62 opened Apr 20, 2024 by TamAIRC
difficult to install
#61 opened Mar 12, 2024 by lvwanwan2022
clang: error: no such file or directory: 'fastBPE/fastBPE.cpp'
#60 opened Aug 16, 2023 by ver007
3
Whether to support byte-level-bpe？
#59 opened Apr 25, 2023 by Alex-Songs
module 'fastBPE' has no attribute 'fastBPE'
#57 opened Feb 14, 2023 by yuhangjiang22
2
los valores es {suma}") #Se imprime la suma
#56 opened Jun 1, 2022 by miguelangelpro4
core dumped error during learnbpe
#55 opened Mar 19, 2022 by SylasreeKS
Error occurred when install fastBPE with pip3 on Windows
#54 opened Feb 24, 2022 by hsiang-lee
1
codes_path and vocab_path should be changed to what parameters should be given
#53 opened Jan 12, 2022 by S-GeGe
1
Read 311990 words (17104 unique) from text file. terminate called after throwing an instance of 'std::bad_alloc' what(): std::bad_alloc Aborted (core dumped)
#52 opened Nov 22, 2021 by dinaalaaahmed
Can fastBPE use the subword codes file?
#51 opened Nov 4, 2021 by SefaZeng
limitVocab
#50 opened Oct 22, 2021 by geert56
Cant install fastBPE on windows 10
#49 opened May 18, 2021 by shadmanhiya
1
Crash without cython installed !
#46 opened Dec 11, 2020 by QuentinN42
1
Cant install fastBPE on windows 10
#44 opened Aug 2, 2020 by nag0811
unable to compile in windows ,workaround suggested under pytorch / fairseq error #1224 is also not working
#43 opened Jul 31, 2020 by AjitAntony
Still can't install on Win 10
#42 opened Jul 8, 2020 by zslotyi
fastBPE installation error
#41 opened Jul 7, 2020 by anjalibhavan
1
fatal error C1083: Cannot open include file: 'sys/mman.h': No such file or directory
#40 opened Jun 15, 2020 by acmilannesta
1
Any plans to add BPE-Dropout?
#39 opened May 19, 2020 by CyndxAI
2
Generate release?
#38 opened Feb 3, 2020 by oblute
Hi, awesome work! But does it support to add special tokens for tokenization?
#37 opened Jan 6, 2020 by jianliu-ml
Question about learnbpe
#36 opened Dec 3, 2019 by dreamingo
1
ProTip! Adding no:label will show everything without a label.