LxMLS / lxmls-toolkit

Machine Learning applied to Natural Language Processing Toolkit used in the Lisbon Machine Learning Summer School
Other
222 stars 216 forks source link

Adding base transformer implementation #180

Closed venelink closed 1 year ago

venelink commented 1 year ago

Adding the base files from mini gpt (minor fixes on internal dependencies and a weird bug that I got on google collab, but not on local machine)

Adding two example notebooks: using pre-trained GPT for prompting and training a GPT model from scratch on a simple sequence prediction task inspired by POS tagging.

To do: