chengchingwen / Transformers.jl

Julia Implementation of Transformer models
MIT License
523 stars 74 forks source link

gpt / gpt2 textencoder and hgf gpt2 tokenizer #111

Closed chengchingwen closed 2 years ago

chengchingwen commented 2 years ago

follow up #83

codecov[bot] commented 2 years ago

Codecov Report

Merging #111 (227b36f) into master (98ae55b) will decrease coverage by 1.10%. The diff coverage is 4.33%.

@@            Coverage Diff             @@
##           master     #111      +/-   ##
==========================================
- Coverage   20.66%   19.55%   -1.11%     
==========================================
  Files          76       78       +2     
  Lines        3635     3974     +339     
==========================================
+ Hits          751      777      +26     
- Misses       2884     3197     +313     
Impacted Files Coverage Δ
src/gpt/gpt.jl 39.39% <ø> (+1.15%) :arrow_up:
src/gpt/load_pretrain.jl 0.00% <0.00%> (ø)
src/gpt/npy2bson.jl 0.00% <0.00%> (ø)
src/gpt/textencoder.jl 0.00% <0.00%> (ø)
src/huggingface/download.jl 0.00% <0.00%> (ø)
src/huggingface/implementation/gpt2/tokenizer.jl 0.00% <0.00%> (ø)
src/huggingface/implementation/utils.jl 0.00% <0.00%> (ø)
src/basic/embeds/utils.jl 63.93% <22.22%> (ø)
src/basic/embeds/vocab.jl 80.76% <40.00%> (-5.90%) :arrow_down:
src/basic/embeds/textencoder.jl 55.26% <100.00%> (ø)
... and 35 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.