rsennrich subword-nmt issues

rsennrich / subword-nmt

Unsupervised Word Segmentation for Neural Machine Translation and Text Generation

MIT License

2.18k stars 463 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

AttributeError: 'BPE' object has no attribute 'glossaries_regex'

#120 zwshan opened 7 months ago
1
How to find all valid BPEs for a word?

#119 hlthu closed 1 year ago
3
Is it possibile to extend a trained BPE model's merge operations?

#118 pluiez opened 1 year ago
2
BrokenPipeError: [Errno 32] Broken pipe

#117 whher closed 1 year ago
3
learn_bpe.py code question

#116 lzp-man closed 2 years ago
1
How to decode BPE when applied to machine translation

#115 ShaoDonCui closed 2 years ago
1
Error: invalid line 2 in BPE codes file when running apply_bpe.py

#114 jo0704 closed 2 years ago
1
applying BPE(Byte Pair Encoding) fails for large Chinese data tokenized with THULAC

#113 caesardai closed 2 years ago
1
How to avoid special char like '\t' being split by bpe

#112 rangehow closed 2 years ago
3
Unknown word and vocabulary filter

#111 Hannibal046 closed 2 years ago
2
Question about vocabulary filter

#110 Hannibal046 closed 2 years ago
2
Readme update please

#109 youyinnn closed 2 years ago
1
About the vocabulary size

#108 TomasAndersonFang closed 2 years ago
2
No module named apply_bpe

#107 RamoramaInteractive closed 2 years ago
4
DeprecationWarning and ResourceWarning: Enable tracemalloc to get the object allocation traceback

#106 RamoramaInteractive closed 2 years ago
2
Recover back code file

#105 Hannibal046 closed 2 years ago
1
BPE-Dropout question

#104 oaarnikoivu closed 3 years ago
1
learn_joint_bpe_and_vocab.py for Japanese

#103 lovodkin93 closed 2 years ago
1
learn_bpe.py error

#102 unwritten opened 3 years ago
1
subword-nmt

#101 jh072535 closed 2 years ago
3
Add note about BPE-Dropout during training

#100 VProv closed 3 years ago
1
Expected format of input

#99 hlncrg closed 2 years ago
1
About how to use BPE in NMT.

#98 TomasAndersonFang closed 3 years ago
2
Add tokens after pretraining

#97 Bachstelze closed 3 years ago
1
BUG : Generating a vocab.bpe file "Killed"

#96 Skylixia closed 3 years ago
2
BPE vocabulary config

#95 anrizal closed 4 years ago
1
Add parallel support (--num-workers)

#94 yimmon closed 4 years ago
1
Restoring BPE

#93 Oxi84 closed 4 years ago
1
solve unicode errors when reading the bpe codes file

#92 yimmon closed 4 years ago
1
Add --seed command-line argument to apply-bpe

#91 noe closed 4 years ago
0
Seed for --dropout

#90 noe closed 4 years ago
1
Facebook ParlAI Blender subword-nmt fails

#89 gibmaxn closed 2 years ago
2
Use Subword NMT inline in my python code

#88 ajesujoba closed 4 years ago
3
Feature/3 single token eot

#87 gcooper-isi closed 4 years ago
0
UnicodeDecodeError: fairseq-interactive example

#86 isVoid closed 4 years ago
2
How to use the old version of bpe with the seperated </w> token?

#85 LearnedVector closed 4 years ago
1
Meaning of the output file of learn_bpe.py

#84 Gromy1211 closed 4 years ago
2
Intra-word boundary marker

#83 Darenar closed 3 years ago
1
BPE is language dependent or not?

#82 umeshpant closed 4 years ago
1
apply bpe-dropout in subword-nmt cli mode

#81 kweonwooj closed 4 years ago
1
How to recover the BPE

#80 QAQ-v closed 4 years ago
2
question about joint bpe vocab size

#79 zrlhk closed 4 years ago
1
Trouble with a JavaScript Corpus

#78 shamoons closed 4 years ago
3
Problem with a large corpus

#77 nguyenvulebinh closed 5 years ago
2
About Programmatically usage

#76 loretoparisi closed 5 years ago
9
For languages that not share an alphabet, like chinese and english, should I train the shared bpe model or train their own bpe model separately?

#75 luckysofia closed 5 years ago
4
bash: ./subword-nmt/subword-nmt/apply_bpe.py: No such file or directory

#74 sanjita-suresh closed 5 years ago
4
Importing and using learn_bpe and apply_bpe from a Python shell

#73 mlforcada closed 5 years ago
1
How to identify the subunits in an encoded text

#72 CodingJonas closed 5 years ago
4
too many @ in the result

#71 kFoodie closed 5 years ago
7