search

OoriData / OgbujiPT

Client-side toolkit for using large language models, including where self-hosted
Apache License 2.0
101 stars 8 forks source link

Qdrant helper update() should support iterator of chunks #85

Open uogbuji opened 3 months ago

uogbuji commented 3 months ago

The new chunkers, post #30, are now generators, but that does us no good with Qdrant helper update() requiring a fixed sequence.

Also consider the PG helper insert_many() as well, though that might require e.g. some sort of built-in batching.