srush / raspy

An interactive exploration of Transformer programming.
https://srush.github.io/raspy
MIT License
240 stars 20 forks source link
transformer

RASPy

Blog

or

Colab

This repo is a reimplementation for RASP as really neat language for thinking about transformer calculations.

This version is done completely in Python as an embedded domain specific language.