search

Modalities / modalities

Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.
MIT License
63 stars 8 forks source link

Add Type Annotations to RotaryTransform #220

Open mali-git opened 3 months ago

mali-git commented 3 months ago

Feature request

Add the missing type annotations to RotaryTransform: https://github.com/Modalities/modalities/blob/44bfe4ca66be2dbba405d07e52691aa5f15939a4/src/modalities/models/gpt2/gpt2_model.py#L49

Motivation

Improves code quality and supports code understanding.