Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
BSD 3-Clause "New" or "Revised" License
5.67k
stars
513
forks
source link
Has anyone run this code with bs>1 and speculatively? #214
Open
deafTim opened 4 weeks ago
Has anyone run this code with bs>1 and speculatively?