feat: Add git-gpt2 models - Githubissues

turingmotors / heron

Apache License 2.0

165 stars 25 forks source link

feat: Add git-gpt2 models #26

Open Ino-Ichan opened 1 year ago

Ino-Ichan commented 1 year ago

Pull Request Title

Description

Purpose of the PR

Added GIT-GPT2 models

Related Issue(s)

Nothing

Changes

Add heron/models/git_llm/git_gpt2
Add model utils for GIT-GPT2
Add .gitattributes for dropping notebooks from GitHub language stats

Model/Algorithm Performance

Training a GIT-GPT2 model and validating that it can say anything

Dependencies

Nothing

Reviewer Notes

Please review and flag anything that seems strange or out of place.

Confirmed

[x] I have updated the documentation accordingly.
[x] I have adhered to the coding standards and guidelines of this project.
[x] I have added comments, especially in hard-to-understand areas.