certainlyio / nordic_bert

Pre-trained Nordic models for BERT
Creative Commons Attribution 4.0 International
158 stars 11 forks source link

[suggestion] Upload models to HuggingFace transformer database #8

Closed saattrupdan closed 4 years ago

saattrupdan commented 4 years ago

The NLP startup HuggingFace is specialising in transformer models, and they've created a database full of pretrained models, to which you might be interested in uploading your models as well:

https://huggingface.co/models

It would then be simple to use your models, using their transformers python library:

from transformers import AutoTokenizer, AutoModelWithLMHead
tokenizer = AutoTokenizer.from_pretrained("botxo/danish_bert_uncased_v2")
model = AutoModelWithLMHead.from_pretrained("botxo/danish_bert_uncased_v2")

There are already a decent chunk of Swedish models and a couple of Finnish ones, but no Danish or Norwegian ones yet.

This is just a heads up in case you didn't already know about this! (I'm not affliated with HuggingFace in any way)

mollerhoj commented 4 years ago

Thanks for the suggestion! We're still considering how to best publish these models. Training them requires significant resources, so business understandably wants to ensure that we're receiving some form of recognition. This will be an ongoing discussion on our part - but in short, it's a business decision.

AngledLuffa commented 2 years ago

To follow up on this, is there a possibility of seeing these models on HuggingFace? It's a super convenient way to organize all of the transformers in the world, although admittedly the only exposure Certainly would get would be the name of the model

saattrupdan commented 2 years ago

To follow up on this, is there a possibility of seeing these models on HuggingFace? It's a super convenient way to organize all of the transformers in the world, although admittedly the only exposure Certainly would get would be the name of the model

The Danish model was published at https://huggingface.co/Maltehb/danish-bert-botxo (BotXO was Certainly's previous name). Not sure about the others.

AngledLuffa commented 2 years ago

excellent, ty!