Fix Bug when using RoPE embeddings together with gradient activation

Modalities / modalities

Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.

MIT License

59 stars 5 forks source link

Open le1nux opened 5 months ago

le1nux commented 5 months ago

@mali-git I converted this card to an issue. Since the card has been in the project TODO column for quite some time, is this still a todo?