(Huggingface) Transformers

[dkmiller]

Seems super cool: https://github.com/huggingface/transformers

Also, e.g. https://huggingface.co/bert-base-uncased?text=The+goal+of+life+is+%5BMASK%5D.

Additional links:

• A Deep Dive Into the Transformer Architecture — The Development of Transformer Models
• Illustrated Guide to Transformers- Step by Step Explanation
• Attention is all you need
• What exactly are keys, queries, and values in attention mechanisms?