microsoft / archai

Accelerate your Neural Architecture Search (NAS) through fast, reproducible and modular research.

https://microsoft.github.io/archai

MIT License

467 stars 92 forks source link

Removes unused attribute which clashes with latest transformers. #194

Closed gugarosa closed 1 year ago

gugarosa commented 1 year ago

Pull Request Template

Description

Updates transformers to require the latest version.
CodeGenConfig does not have scale_attn_weights anymore because it is not used, and hence the same attribute has been deprecated from CausalSelfAttention because it was not used as well.
Cleans up test_lamb_optimizer.py to prevent issues with PyTorch 2.0+.

Changes

[X] Bug fix (non-breaking change which fixes an issue)

Configuration:

Archai version: 1.0.0
Environment: Python 3.7
OS: Windows 11

Final checks:

[X] Follows guidelines of project
[X] Self-review of code
[X] Commented code in hard-to-understand areas
[X] Corresponding changes to the documentation
[X] Changes generate no new warnings
[X] Dependent changes have already been merged
[X] Checked code correction any misspellings