setting the pad_token of tokenizer & use AriaProcessor during evaluation & fix: use length of input_ids find the output slice instead of input_string - Githubissues

rhymes-ai / Aria

Codebase for Aria - an Open Multimodal Native MoE

Apache License 2.0

375 stars 20 forks source link

setting the pad_token of tokenizer & use AriaProcessor during evaluation & fix: use length of input_ids find the output slice instead of input_string #6

Closed Coobiw closed 1 week ago