search

chengchingwen / Transformers.jl

Julia Implementation of Transformer models
MIT License
526 stars 75 forks source link

Support gpu with julia v1.6 #49

Closed zsz00 closed 3 years ago

zsz00 commented 3 years ago

Hope to support julia v1.6

chengchingwen commented 3 years ago

1.6 is supported with v0.1.8

chengchingwen commented 3 years ago

Right now the gpu part seems to failed, but cpu part should work fine

chengchingwen commented 3 years ago

Running softmax with CUDA v2.6.2 and NNlib v0.7.17 result in wrong values, but this is fixed on their master. We will need to halt gpu support until they tag new release.

chengchingwen commented 3 years ago

Should be fix by v0.1.12