chengchingwen / Transformers.jl

Julia Implementation of Transformer models
MIT License
523 stars 74 forks source link

Adapting Huggingfaceapi #103

Closed chengchingwen closed 2 years ago

chengchingwen commented 2 years ago

follow up #83.

Rewrite huggingface module with Huggingfaceapi.jl and handle the tokenizer.

codecov[bot] commented 2 years ago

Codecov Report

Merging #103 (0ae19c0) into master (9bd6b85) will decrease coverage by 1.28%. The diff coverage is 2.53%.

@@            Coverage Diff             @@
##           master     #103      +/-   ##
==========================================
- Coverage   22.05%   20.76%   -1.29%     
==========================================
  Files          69       76       +7     
  Lines        3378     3616     +238     
==========================================
+ Hits          745      751       +6     
- Misses       2633     2865     +232     
Impacted Files Coverage Δ
src/Transformers.jl 0.00% <ø> (ø)
src/experimental/model.jl 0.00% <0.00%> (ø)
src/huggingface/HuggingFace.jl 0.00% <0.00%> (ø)
src/huggingface/configs/auto.jl 0.00% <0.00%> (ø)
src/huggingface/configs/config.jl 0.00% <0.00%> (ø)
src/huggingface/configs/pretrain.jl 0.00% <0.00%> (ø)
src/huggingface/download.jl 0.00% <0.00%> (ø)
src/huggingface/implementation/bert/config.jl 0.00% <ø> (ø)
src/huggingface/implementation/bert/model.jl 0.00% <0.00%> (ø)
src/huggingface/implementation/bert/tokenizer.jl 0.00% <0.00%> (ø)
... and 11 more

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 9bd6b85...0ae19c0. Read the comment docs.