Currently, for models that don't specify pad token, we use eos token as the default. However, this breaks if the model repo configures a different eos token, since the pad one is still the default (and may be invalid). This moves the fallback to where we actually use the pad token.
Currently, for models that don't specify pad token, we use eos token as the default. However, this breaks if the model repo configures a different eos token, since the pad one is still the default (and may be invalid). This moves the fallback to where we actually use the pad token.