search

georgian-io / Multimodal-Toolkit

Multimodal model for text and tabular data with HuggingFace transformers as building block for text data
https://multimodal-toolkit.readthedocs.io
Apache License 2.0
587 stars 84 forks source link

Support for other BERT models #26

Closed dsi-idc closed 1 year ago

dsi-idc commented 2 years ago

hi! Can I expect the package to work on other BERT models (not listed in the ReadMe) -- e.g., longformer

thank you!

akashsaravanan-georgian commented 1 year ago

There's no direct support for models not listed in the readme. However, you should be able to add such models on your own. Take a look at multimodal_transformers/model/tabular_transformers.py for existing implementations and feel free to open up a PR if you do add models :)