In generate() call, we only pass in the input_ids field and rely on huggingface module to populate the attention mask fields. We now pass in the whole user input dict instead.
Testing Done
Tutorial test run passed.
Checklist:
[x] My PR title strictly follows the format: [Your Priority] Your Title
Description
In
generate()call, we only pass in theinput_idsfield and rely on huggingface module to populate the attention mask fields. We now pass in the whole user input dict instead.Testing Done
Tutorial test run passed.
Checklist:
[Your Priority] Your Title