The Cerebros package is an ultra-precise Neural Architecture Search (NAS) / AutoML that is intended to much more closely mimic biological neurons than conventional neural network architecture strategies.
If we add a word2vec or tfidf input embedding to a Cerebros module and make 500 separate softmax outputs, 1 for each of 500 sequential words, then an argmax then a vocabulary lookup, we could train this on a small sample of pairs of summarized writing instructions and desired full text writing task results. This may make this do the same type of task as ChatGPT.
Also, doing the inverse operation may make a good summarization engine.
If we add a word2vec or tfidf input embedding to a Cerebros module and make 500 separate softmax outputs, 1 for each of 500 sequential words, then an argmax then a vocabulary lookup, we could train this on a small sample of pairs of summarized writing instructions and desired full text writing task results. This may make this do the same type of task as ChatGPT.
Also, doing the inverse operation may make a good summarization engine.