feat: update libraries - Githubissues

turingmotors / heron

Apache License 2.0

163 stars 25 forks source link

feat: update libraries #30

Closed Ino-Ichan closed 8 months ago

Ino-Ichan commented 8 months ago

Pull Request Title

Description

Purpose of the PR

Update some libraries.

Related Issue(s)

Nothing

Changes

Updated libraries are as follow;
- torch
- deepspeed
- accelerate
- transformers
Add instruction for installing flash-attention

Model/Algorithm Performance

Nothing

Dependencies

Update some libraries.

Reviewer Notes

Highlight any areas you'd like the reviewer to pay special attention to. (For example: "Please review the initialization method in the XYZ layer.")

Confirmed

[x] I have updated the documentation accordingly.
[x] I have adhered to the coding standards and guidelines of this project.
[x] I have added comments, especially in hard-to-understand areas.