Fork set up - Githubissues

alan-turing-institute / minGPT

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

MIT License

1 stars 0 forks source link

Closed rchan26 closed 1 month ago

rchan26 commented 1 month ago

Set up pre-commit
Set up pyproject.toml using Poetry
Update README
Tested a run of the notebooks (locally on mac using 'mps')
Very small stuff like adding a logger to import around for logging and random line changes so that can use 'mps' easier and for autodetecting that
A bit of refactoring by moving different components (the activation function and attention mechanism) to their own files which are imported into the model

review-notebook-app[bot] commented 1 month ago

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.