neuralmind-ai / portuguese-bert

Portuguese pre-trained BERT models
Other
792 stars 122 forks source link

Some questions about the model #36

Open Benjamim-EP opened 3 years ago

Benjamim-EP commented 3 years ago

Hi I would like to thank you for the model, I am working on my graduation project from your trained model, which I will clearly quote to you, I am using the google translator so sorry if there are inconsistent sentences, I am Brazilian.

Well, 1 - I wanted to know which database you used to train your model, if you yourself created or used a ready-made one like OSCAR for example 2 - I have no experience in training natural language processing models of this magnitude, and I want to train another one as big as this one, however I wanted to know if it would be possible to train another BER model but for a specific field of study, such as psychology for example, I can as an example to gather all Freud's books and train the model only for this subset of information, without using a generic dataset with several texts from several different fields?

The idea of ​​2 is to make the meaning of certain words more restrictive, for example the word 'depression' which in a general context means something, but in psychology it is something much more concrete