search

karpathy / minGPT

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
MIT License
20.31k stars 2.53k forks source link

where did the self.bias get defined in the casual attention class #133

Open nebyu08 opened 8 months ago

theicfire commented 7 months ago

It's here: https://github.com/karpathy/minGPT/blob/master/mingpt/model.py#L47