PetrochukM / PyTorch-NLP

Basic Utilities for PyTorch Natural Language Processing (NLP)
https://pytorchnlp.readthedocs.io
BSD 3-Clause "New" or "Revised" License
2.21k stars 258 forks source link

There is bpemb, but there is no Byte-Pair Encoding. #81

Closed ghost closed 5 years ago

ghost commented 5 years ago

Expected Behavior

Actual Behavior

Steps to Reproduce the Problem

1. 2. 3.

PetrochukM commented 5 years ago

Please provide more information... What do you mean there is "no Byte-Pair encoding"?

ghost commented 5 years ago

Please provide more information... What do you mean there is "no Byte-Pair encoding"?

Encoder for bpemb.

PetrochukM commented 5 years ago

Sorry. Please use full sentences instead of phrases when submitting issues. I won't be taking the time to figure out your cryptic references.

I'm closing this until then.