ā ļø Please check that this feature request hasn't been suggested before.
[X] I searched previous Ideas in Discussions didn't find any similar feature requests.
[X] I searched previous Issues didn't find any similar feature requests.
š Feature description
Transformers recently refactored flash attention. At current point in time, axolotl replaces the _get_unpad_data for its multipack feature. Instead, replace the central _get_unpad_data in the new transformers.
https://github.com/huggingface/transformers/pull/31446
āļø Solution
Replace the long if-statement in monkeypatch/multipack and directly replace the centralized unpad function:
ā ļø Please check that this feature request hasn't been suggested before.
š Feature description
Transformers recently refactored flash attention. At current point in time,
axolotl
replaces the_get_unpad_data
for its multipack feature. Instead, replace the central_get_unpad_data
in the new transformers. https://github.com/huggingface/transformers/pull/31446āļø Solution
Replace the long if-statement in monkeypatch/multipack and directly replace the centralized unpad function:
ā Alternatives
No response
š Additional Context
No response
Acknowledgements