Closed ljleb closed 1 year ago
actually, one way to fix this is to introduce trailing BREAK
keywords in embeddings that would otherwise be too small. not sure how to test whether a prompt will generate an embed that is too small however.
can we just concatenate embeds filled with zeroes?
to test this we can just inspect the embeddings generated when including a trailing BREAK
in a prompt vs when leaving it as is.
interpolating between i.e. embeds of size 75 and 150 will not work. for example,
a [b:c BREAK:,] d
will generate this situation. to fix this we can look at what theBREAK
keyword does in the webui repo maybe?