First timer - Githubissues

NaNoGenMo / 2024

National Novel Generation Month, 2024 edition.

10 stars 1 forks source link

Open Mac-Nerd opened 1 month ago

Mac-Nerd commented 1 month ago

My plan is to generate my work using an Apple II, either on real hardware or emulation.

savetz commented 1 month ago

Fun! Using BASIC?

Mac-Nerd commented 1 month ago

Assembly. Based on some Very Small Language Model experiments I've been working on.

The plan

Tokenize the text of Mary Shelley's Frankenstein and Charlotte Bronte's Jane Eyre (because why not)
Compress and hash the token strings (length N characters) with candidate N+1 character options
Hash a "prompt" phrase, search for matching token hashes.
Choose the next character from appropriate candidates.
Resulting string becomes next prompt.
Repeat.