tsa trust_remote_code=True

[egilron]

trust_remote_code=True seems to be needed now, for the config = AutoConfig.from_pretrained.
Hard-coding this seems not to be too dangerous.

[akutuzov]

It is needed only for models lacking the proper Transformers class (like LTG-Bert, for example). For all the rest, there's no need to use this (potentially very dangerous) parameter.

[egilron]

OK. Maybe I'll change the default model in stead then, so that the script runs with default settings.

[akutuzov]

May be it makes sense for now to simply put if/else statements checking whether the model has ltg/norbert3 in its name, and if yes, then turn on trust_remote_code=True?