fix huggingface wrapper not support distilbert

VIDA-NYU / alpha-automl

Alpha-AutoML is a Python library for automatically generating end-to-end machine learning pipelines.

https://alpha-automl.readthedocs.io

Apache License 2.0

19 stars 3 forks source link

Closed EdenWuyifan closed 9 months ago

EdenWuyifan commented 9 months ago

Fix bug found by @julesbarbosa

Wrapper not support some bert models since the tokenizer didn't return _token_typeids