search

asyml / texar-pytorch

Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/
https://asyml.io
Apache License 2.0
745 stars 117 forks source link

Add encode_text_for_generation in XLNetTokenizer #278

Closed gpengzhi closed 4 years ago

gpengzhi commented 4 years ago

resolve #258

I am not sure that adding all functions in the base class to the corresponding subclass is reasonable.

codecov[bot] commented 4 years ago

Codecov Report

Merging #278 into master will increase coverage by <.01%. The diff coverage is 88.46%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #278      +/-   ##
==========================================
+ Coverage   83.07%   83.08%   +<.01%     
==========================================
  Files         195      195              
  Lines       15323    15349      +26     
==========================================
+ Hits        12729    12752      +23     
- Misses       2594     2597       +3
Impacted Files Coverage Δ
...exar/torch/data/tokenizers/xlnet_tokenizer_test.py 97.05% <100%> (+0.2%) :arrow_up:
texar/torch/data/tokenizers/xlnet_tokenizer.py 85.03% <82.35%> (-0.36%) :arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 8816361...8aee084. Read the comment docs.