Add cross attention layer and refactor t5_attention

google-ai-edge / ai-edge-torch

Supporting PyTorch models with the Google AI Edge TFLite runtime.

Apache License 2.0

310 stars 40 forks source link

Closed yichunk closed 3 months ago

yichunk commented 3 months ago

Add cross attention layer and refactor t5_attention to inherit from cross attention.

Test the t5 conversion and work.

BUG=b/311216181