chengchingwen / Transformers.jl

Julia Implementation of Transformer models
MIT License
523 stars 74 forks source link

Added example for Text Generation with GPT2 #57

Closed AdarshKumar712 closed 3 years ago

AdarshKumar712 commented 3 years ago

I have created a simple example on Text generation with HuggingFace gpt2 model. Please have a look and suggest if any changes required.

@chengchingwen

codecov[bot] commented 3 years ago

Codecov Report

Merging #57 (242925b) into master (a195980) will increase coverage by 1.20%. The diff coverage is 0.00%.

:exclamation: Current head 242925b differs from pull request most recent head 7546d8d. Consider uploading reports for the commit 7546d8d to get more accurate results Impacted file tree graph

@@            Coverage Diff             @@
##           master      #57      +/-   ##
==========================================
+ Coverage   21.94%   23.14%   +1.20%     
==========================================
  Files          72       77       +5     
  Lines        3559     3603      +44     
==========================================
+ Hits          781      834      +53     
+ Misses       2778     2769       -9     
Impacted Files Coverage Δ
src/huggingface/models/gpt2.jl 0.34% <0.00%> (+0.34%) :arrow_up:
src/huggingface/models/models.jl 0.00% <0.00%> (ø)
src/datasets/glue/glue.jl 100.00% <0.00%> (ø)
src/datasets/qa/clozetest.jl 100.00% <0.00%> (ø)
src/datasets/translate/wmt.jl 100.00% <0.00%> (ø)
src/datasets/translate/iwslt.jl 100.00% <0.00%> (ø)
src/datasets/Datasets.jl 100.00% <0.00%> (ø)
src/stacks/Stacks.jl 100.00% <0.00%> (ø)
src/gpt/GenerativePreTrain.jl 100.00% <0.00%> (ø)
src/bert/BidirectionalEncoder.jl 100.00% <0.00%> (ø)
... and 11 more

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update a9f3f4e...7546d8d. Read the comment docs.

AdarshKumar712 commented 3 years ago

Done!