search

chengchingwen / Transformers.jl

Julia Implementation of Transformer models
MIT License
526 stars 75 forks source link

Module Broken? #28

Closed zzj0402 closed 4 years ago

zzj0402 commented 4 years ago

(@JuliaPro_v1.5.0-1) 

julia> using Transformers
[ Info: Precompiling Transformers [21ca0261-441d-5938-ace7-c90938fde4d4]
WARNING: Method definition _pullback(Zygote.Context, typeof(Flux.onehot), Any...) in module Flux at C:\Users\xxx\.julia\packages\Zygote\rqvFi\src\lib\grad.jl:8 overwritten in module Basic at C:\Users\xxx\.julia\packages\Zygote\rqvFi\src\lib\grad.jl:8.
  ** incremental compilation may be fatally broken for this module **
chengchingwen commented 4 years ago

No, it's because we override and extend the behavior of Flux.OneHotVector. It shouldn't affect anything in most of the cases, but we'll fix this warning in the next release.