Closed cyanguwa closed 3 months ago
This PR improves the function check_set_window_size in PyTorch so that window_size is always appropriately set based on the mask type.
check_set_window_size
window_size
no_mask, padding : window_size = (-1, -1) or (>=0, >=0) causal, padding_causal: window_size = (-1, 0) arbitrary : window_size = (-1, -1)
Please list the changes introduced in this PR:
attn_mask_type
/te-ci pytorch
Description
This PR improves the function
check_set_window_size
in PyTorch so thatwindow_size
is always appropriately set based on the mask type.Type of change
Changes
Please list the changes introduced in this PR:
window_size
andattn_mask_type
to ensure they are consistent.Checklist: