AliOsm / chromable

Ruby on Rails integration for ChromaDB
https://github.com/AliOsm/chromable
MIT License
5 stars 0 forks source link

Support background jobs for embedding calculation #3

Open AliOsm opened 9 months ago

bendangelo commented 8 months ago

Background jobs are complex, some people use sidekiq, or active job. Some jobs might even batch it. I think it's better to not add this and let the user setup it up.

AliOsm commented 8 months ago

I found that meilisearch-rails gem is using an ActiveJob job to perform indexing/removing from index in the background here. What do you think about that?

bendangelo commented 8 months ago

That can work but for my use case (updating a lot of records at once), I have a background job that batches using sidekiq-iteration. As long as it can be disabled it should be ok.