JulesBelveze / bert-squeeze

🛠️ Tools for Transformers compression using PyTorch Lightning ⚡
https://julesbelveze.github.io/bert-squeeze/
79 stars 10 forks source link

Refactor Transformer Models & Extend Encoder-Decoder Support #64

Closed JulesBelveze closed 7 months ago

JulesBelveze commented 7 months ago

Description

This pull request introduces significant changes to the Transformer-based modules within the bert_squeeze package. Refactoring was performed to streamline model instantiation, and new features were added for better integration of encoder-decoder models, especially custom ones.

Changelog

Features

Refactors

Test Updates