Feat/batch database builds - Githubissues

YenRaven / annoy_ltm

annoy long term memory experiment for oobabooga/text-generation-webui

31 stars 3 forks source link

Feat/batch database builds #20

Closed YenRaven closed 1 year ago

YenRaven commented 1 year ago

Support for 8k superhot models with the ExLlama loaders
concurrent annoy database building and file saving to not block responses