glample fastBPE issues - Githubissues

glample / fastBPE

Fast BPE

MIT License

656 stars 96 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

rename main.cc to fastBPE.cpp

#65 hellyguo closed 5 months ago
1
fastBPE will not install on windows 11 or WSL

#64 Otto-V-Bismarck opened 5 months ago
3
terminate called after throwing an instance of 'c10::Error' what(): [enforce fail at inline_container.cc:319] . unexpected pos 2302963008 vs 2302962896 frame #0: c10::ThrowEnforceNotMet(char const*, int, char const*, std::string const&, void const*) + 0x55 (0x15158b1320a5 in /usr/local/lib/python3.8/dist-packages/torch/lib/libc10.so)

#63 lldd1001 opened 7 months ago
0
Fails to build on Python 3.11 - longintrepr.h: No such file or directory

#62 TamAIRC opened 7 months ago
0
difficult to install

#61 lvwanwan2022 opened 8 months ago
0
clang: error: no such file or directory: 'fastBPE/fastBPE.cpp'

#60 ver007 opened 1 year ago
3
Whether to support byte-level-bpe？

#59 Alex-Songs opened 1 year ago
0
Build fails on Windows 10: Missing `<sys/mman.h>`

#58 sydrawat01 closed 1 year ago
3
module 'fastBPE' has no attribute 'fastBPE'

#57 yuhangjiang22 opened 1 year ago
2
los valores es {suma}") #Se imprime la suma

#56 miguelangelpro4 opened 2 years ago
0
core dumped error during learnbpe

#55 SylasreeKS opened 2 years ago
0
Error occurred when install fastBPE with pip3 on Windows

#54 hsiang-lee opened 2 years ago
1
codes_path and vocab_path should be changed to what parameters should be given

#53 S-GeGe opened 2 years ago
1
Read 311990 words (17104 unique) from text file. terminate called after throwing an instance of 'std::bad_alloc' what(): std::bad_alloc Aborted (core dumped)

#52 dinaalaaahmed opened 2 years ago
0
Can fastBPE use the subword codes file?

#51 SefaZeng opened 3 years ago
0
limitVocab

#50 geert56 opened 3 years ago
0
Cant install fastBPE on windows 10

#49 shadmanhiya opened 3 years ago
1
Update README.md with a dependency for Python API

#48 parthe opened 3 years ago
1
【vocab size】Is there another way to limit the vocab size?

#47 imyzx2017 closed 3 years ago
1
Crash without cython installed !

#46 QuentinN42 opened 3 years ago
1
Can't install in Ubuntu 20.04

#45 1mike12 closed 4 years ago
1
Cant install fastBPE on windows 10

#44 nag0811 opened 4 years ago
0
unable to compile in windows ,workaround suggested under pytorch / fairseq error #1224 is also not working

#43 AjitAntony opened 4 years ago
0
Still can't install on Win 10

#42 zslotyi opened 4 years ago
0
fastBPE installation error

#41 anjalibhavan opened 4 years ago
1
fatal error C1083: Cannot open include file: 'sys/mman.h': No such file or directory

#40 acmilannesta opened 4 years ago
1
Any plans to add BPE-Dropout?

#39 CyndxAI opened 4 years ago
2
Generate release?

#38 oblute opened 4 years ago
0
Hi, awesome work! But does it support to add special tokens for tokenization?

#37 jianliu-ml opened 4 years ago
0
Question about learnbpe

#36 dreamingo opened 4 years ago
1
ReadCodes error

#35 zhishui3 opened 5 years ago
2
fastBPE install on win10

#34 GeorgeS2019 closed 5 years ago
1
Error while compiling

#33 aastha19 opened 5 years ago
1
Add language_level to fastBPE.pyx

#32 myleott closed 5 years ago
1
Python api for learnbpe

#31 tonylekhtman opened 5 years ago
0
getvocab issue using french text

#30 ctoffo closed 5 years ago
0
about adding the word blacklist for BPE

#29 ghchen18 opened 5 years ago
0
Error when install with cython

#28 liug0324 opened 5 years ago
1
python setup.py install failure

#27 sergeman opened 5 years ago
5
setup fails when Cython is not available

#26 ink1 opened 5 years ago
2
Update setup.py for PyPI release

#25 myleott closed 5 years ago
0
Nothing happens after applybpe

#24 kayoyin closed 5 years ago
5
Mention extras needed for Mac OS users in README

#23 bharatr21 closed 5 years ago
1
learnbpe and the process is killed

#22 tuanshanyou opened 5 years ago
1
question about applybpe

#21 teslacool closed 5 years ago
4
fast.cc: No such file or directory

#20 miaodl closed 5 years ago
1
Error when using Python API

#19 sashank06 opened 5 years ago
1
'ios' file not found

#18 willy20040711 opened 5 years ago
2
Verbose mode

#17 villmow closed 5 years ago
1
Add `vocab_path=""` as default for python fastBPE constructor

#16 louismartin closed 5 years ago
0