search

wwerkk / MC-FP

1 stars 0 forks source link

generated token sequence - alternating buffer #13

Closed wwerkk closed 1 year ago

wwerkk commented 1 year ago

on a M1 MacBook Pro CPU it does not seem to be possible to generate sequences longer than 32 tokens fast enough to keep up with real-time, at least with the trebles model. alternating token buffers need to be implemented so that while one token sequence is being played through, another can be generated at the same time

wwerkk commented 1 year ago

although it could be implemented more carefully in the future, this is done as of https://github.com/wwerkk/MC-FP/commit/b145891370ba20d51438efadeffa29b517b06c0a