pytorch / captum

Model interpretability and understanding for PyTorch
https://captum.ai
BSD 3-Clause "New" or "Revised" License
4.84k stars 489 forks source link

stop stripping first character from output string #1351

Closed csauper closed 1 week ago

csauper commented 1 week ago

Summary: previously first character was stripped as SOS token, but that doesn't actually seem to be the case with current LLMs. Keep all tokens.

Differential Revision: D62775617

facebook-github-bot commented 1 week ago

This pull request was exported from Phabricator. Differential Revision: D62775617

facebook-github-bot commented 1 week ago

This pull request was exported from Phabricator. Differential Revision: D62775617

facebook-github-bot commented 1 week ago

This pull request was exported from Phabricator. Differential Revision: D62775617

facebook-github-bot commented 1 week ago

This pull request was exported from Phabricator. Differential Revision: D62775617

facebook-github-bot commented 1 week ago

This pull request was exported from Phabricator. Differential Revision: D62775617

facebook-github-bot commented 1 week ago

This pull request was exported from Phabricator. Differential Revision: D62775617

facebook-github-bot commented 1 week ago

This pull request was exported from Phabricator. Differential Revision: D62775617

facebook-github-bot commented 1 week ago

This pull request has been merged in pytorch/captum@7b80c5b4490220b720492e7ba977d48333596361.