Closed Oufattole closed 2 months ago
The MEDS torch models have been significantly enhanced with support for various batch generation styles, LSTM and Transformer models, supervised training, transfer learning models, and new pytest configurations. Key updates include new classes, revamped configuration files, and integration with lightning
and x-transformers
. Additionally, substantial changes to embedding handling and model declaration while maintaining compatibility with existing features.
File(s) | Change Summary |
---|---|
README.md | Added summary of new features, models, and training options. |
pyproject.toml | Updated dependencies for new modules and testing with pytest-sugar , pytest-instafail , and pytest-xdist . |
.../configs/model/default.yaml, .../configs/pytorch_dataset.yaml | Introduced default training configurations for models; removed and added settings accordingly. |
src/meds_torch/embedder.py | Renamed ObservationEmbedder to TripletEmbedder and updated configuration handling. |
src/meds_torch/model/architectures/... | Added new model files for LSTM, Transformers, and support functions. |
tests/test_dataloader.py, tests/test_model.py | Modified test imports and added test cases for new models. |
In the lands of torch, models anew,
With batches styled and transformers in view,
LSTM joins the epic quest,
Supervised, transfer learning at its best!
Pytests shine, dependencies true,
Amidst the code, fresh features grew.
🐇 With leaps and bounds, your data to subdue! 🌟
Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media?
Added support for supervised training with several architectures.
Summary by CodeRabbit
New Features
Configuration Updates
default.yaml
file with parameters for training configurations.pyproject.toml
with new dependencies and testing configurations.Model Updates
MambaModel
,TransformerDecoderModel
, andAttentionAveragedTransformerEncoderModel
.ObservationEmbedder
toTripletEmbedder
.Testing Enhancements