search

pydatabangalore / talks

Talks at PyData Bangalore meetups
MIT License
36 stars 11 forks source link

Transformer Architectures #34

Open ghost opened 4 years ago

ghost commented 4 years ago

Title

Introduction to Transformers and its various descendants like BERT, GPT-2, XLNet, etc

Description

I will be introducing the Transformer architecture in full from its base(encoder, decoder, and self-attention layer) and then if time permits I would like to talk about its descendants like BERT, GPT-2, XLNet, etc.

Duration

Audience

A simple understanding of Neural Networks

Outline

A detailed outline for my talk is described in my medium articles for the same: https://medium.com/@tejanm

Additional notes

Here is a link to my medium articles that I will be referring to: https://medium.com/@tejanm

TrigonaMinima commented 4 years ago

@tejanmehndiratta are you available to speak on 29th?

ghost commented 4 years ago

Yes, I am available to speak on 29th

Thanks and Regards Tejan Mehndiratta

On Sun, 23 Feb, 2020, 17:37 Shivam Rana, notifications@github.com wrote:

@tejanmehndiratta https://github.com/tejanmehndiratta are you available to speak on 29th?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/pydatabangalore/talks/issues/34?email_source=notifications&email_token=AGOHFN2GF7LZFDASAXZ2TETREJRI3A5CNFSM4KZYFNZ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEMV2CLY#issuecomment-590061871, or unsubscribe https://github.com/notifications/unsubscribe-auth/AGOHFN3Y7LE7GJQS6MOFZZ3REJRI3ANCNFSM4KZYFNZQ .