An error occurred when evaluating:
ValueError: Incompatible shapes for attention inputs:
query.shape: torch.Size([20, 9216, 64])
key.shape : torch.Size([40, 77, 64])
value.shape: torch.Size([40, 77, 64])
HINT: We don't support broadcasting, please use expand yourself before calling memory_efficient_attention if you need to
what should I do to solve this?
An error occurred when evaluating: ValueError: Incompatible shapes for attention inputs: query.shape: torch.Size([20, 9216, 64]) key.shape : torch.Size([40, 77, 64]) value.shape: torch.Size([40, 77, 64]) HINT: We don't support broadcasting, please use
expand
yourself before callingmemory_efficient_attention
if you need to what should I do to solve this?