Add support for indictrans2

[bil-ash]

Model description

With the recent support for custom models, is it possible to run IndicTrans2 . It is basically nllb with a custom tokenizer.

Prerequisites

• [X] The model is supported in Transformers (i.e., listed here)
• [X] The model can be exported to ONNX with Optimum (i.e., listed here)

Additional information

No response

Your contribution

None, no idea of whether the custom tokenizer is required on js side or nllb tokenizer is fine.

[xenova]

I think you'll need to re-implement the tokenization yourself, since it does not seem to be compatible with transformers or tokenizers.

You should be able to convert the model though 👍