Pretrained huggingface models

sassoftware / python-dlpy

The SAS Deep Learning Python (DLPy) package provides the high-level Python APIs to deep learning methods in SAS Visual Data Mining and Machine Learning. It allows users to build deep learning models using friendly Keras-like APIs.

Apache License 2.0

224 stars 131 forks source link

Pretrained huggingface models #361

Closed anttiheino closed 3 years ago

anttiheino commented 3 years ago

When specifying a huggingface model, only the models starting with bert-, roberta- and distil- are supported. However, it would enable users to develop models for other languages as well if that restriction was removed. For example, the Finnish model is similar size to bert-uncased, but its name starts with "TurkuNLP/bert" so it cannot be used yet. berterror

eusdougc commented 3 years ago

Hi @anttiheino - we will take a look at the problem and assess the difficulty of the required fix.

eusdougc commented 3 years ago

@anttiheino - you can now clone the master branch and pick up the fix.