I want to investigate the classic BERT model from a literary perpsective and NaNoGenMo seems like the ideal place to do so. I'll be using an approach I'm developing elsewhere, which I call BERTIFIER, to iteratively turn any text into another, BERTified, version of that text. It's a conceptually simple but (to me at least) fun experiment with the conditions of language and semiotics under LLMs.
The main project for my NaNoGenMo participation is the question of how to operate BERTIFIER within the context of the 50.000 words framework. If I generate text, is it then still interesting from the BERTIFIER perpsective? Alternatively, how do I even navigate it if I DON'T generate new text? Do I source it from Project Gutenberg or somehwere else? There's a nontrivial influence of the selected (or generated) source text over the finished novel, so this may be at the crux of the NeNoGenMo-version of BERTIFIER.
There's also something about the process of BERTification itself that can easily be lost if the finished model looks too much like a traditional novel. How do I preserve the process in the product? Is it possible to situate a generative palimpsest?
I want to investigate the classic BERT model from a literary perpsective and NaNoGenMo seems like the ideal place to do so. I'll be using an approach I'm developing elsewhere, which I call BERTIFIER, to iteratively turn any text into another, BERTified, version of that text. It's a conceptually simple but (to me at least) fun experiment with the conditions of language and semiotics under LLMs.
The main project for my NaNoGenMo participation is the question of how to operate BERTIFIER within the context of the 50.000 words framework. If I generate text, is it then still interesting from the BERTIFIER perpsective? Alternatively, how do I even navigate it if I DON'T generate new text? Do I source it from Project Gutenberg or somehwere else? There's a nontrivial influence of the selected (or generated) source text over the finished novel, so this may be at the crux of the NeNoGenMo-version of BERTIFIER.
There's also something about the process of BERTification itself that can easily be lost if the finished model looks too much like a traditional novel. How do I preserve the process in the product? Is it possible to situate a generative palimpsest?