Closed csauper closed 1 week ago
This pull request was exported from Phabricator. Differential Revision: D62775617
This pull request was exported from Phabricator. Differential Revision: D62775617
This pull request was exported from Phabricator. Differential Revision: D62775617
This pull request was exported from Phabricator. Differential Revision: D62775617
This pull request was exported from Phabricator. Differential Revision: D62775617
This pull request was exported from Phabricator. Differential Revision: D62775617
This pull request was exported from Phabricator. Differential Revision: D62775617
This pull request has been merged in pytorch/captum@7b80c5b4490220b720492e7ba977d48333596361.
Summary: previously first character was stripped as SOS token, but that doesn't actually seem to be the case with current LLMs. Keep all tokens.
Differential Revision: D62775617