search

neuralmind-ai / portuguese-bert

Portuguese pre-trained BERT models
Other
792 stars 122 forks source link

Using with SpaCy 3.0 #32

Open elymatos opened 3 years ago

elymatos commented 3 years ago

Hi, Thanks for the good job! Is it possible to use these models with spaCy 3.0? Is there some recipe to this use? (actually the spaCy page about Transformers is not clear on how to train a new pipeline with models like these) Thanks!

fabiocapsouza commented 3 years ago

Hi @elymatos, I don't use spaCy so I can't help you unfortunately. But if spaCy supports BERT models of the Transformers library, it should work with BERTimbau, since the only difference are the weights. If that is the case, a tutorial for English BERT could give you directions.

I'll leave this issue open so others may comment here as well :)

beeepaiva commented 2 years ago

@fabiocapsouza Existe um package pro spaCy 3.0? Na versao espanhol por exemplo: Spanish transformer pipeline (dccuchile/bert-base-spanish-wwm-cased). https://huggingface.co/dccuchile/bert-base-spanish-wwm-cased e como import no spaCy teriamos nlp = spacy.load("es_dep_news_trf")

A forma desse package seria por conta do proprio spaCy ou já existe? Obrigada!!