Support for HuggingFace bert-base-portuguese-cased

chengchingwen / Transformers.jl

Julia Implementation of Transformer models

MIT License

523 stars 74 forks source link

Support for HuggingFace bert-base-portuguese-cased #78

Closed storopoli closed 1 year ago

storopoli commented 2 years ago

Is it possible to support the neuralmind/bert-base-portuguese-cased? We are doing lots of portuguese NLP and this custom BERT model has better performance in our portuguese NLP problems.

Cc'ing a collaborator @RosalRicardo

dcecchini commented 2 years ago

I also wish to have the portuguese models available in Julia. Is there any plan to add those? Or a tutorial where we can transform them by ourselves?

I tried to use the Transformers.BidirectionalEncoder.tfckpt2bson but it needs TensorFlow.jl installed, a package that is not maintained anymore and not compatible with Windows:

chengchingwen commented 2 years ago

Yes, that's on the plan (#83). I'm currently working on fixing the hugginface part so that would be supported in near future. Also the tfckpt2bson would eventually be removed.