search

mead-ml / mead-baseline

Deep-Learning Model Exploration and Development for NLP
Apache License 2.0
243 stars 73 forks source link

Chore/add gpt2 completer #927

Closed dpressel closed 2 years ago

dpressel commented 2 years ago

change to support GPT2 completer. To do this, we need to add GPT2 BPE as an option, and we have to assume that special tokens have not been added