search

tembo-io / pg_vectorize

The simplest way to build AI workloads on Postgres
https://tembo.io/pg_vectorize/
739 stars 33 forks source link

Add chunking support to vectorize.table() #162

Open asr2003 opened 1 month ago

asr2003 commented 1 month ago

Closes #142 /claim #142

asr2003 commented 1 month ago

@ChuckHend Have a look at your free time and kindly approve workflows, if any adjustments needed i am happy to incorporate them

asr2003 commented 1 month ago

Waiting for a quick review on this too - @ChuckHend

asr2003 commented 1 month ago

@ChuckHend Any changes needed here?

ChuckHend commented 3 weeks ago

I might need to provide further clarification in the issue. What is intended is that when calling vectorize.table() on an existing table, each row is split into multiple 'chunks' (one new row for each chunk). I think these new rows will need to live on a separate table.

asr2003 commented 3 weeks ago

@ChuckHend Updated the changes with intended approach of chunking vectorie.table by retreiving rows and lives into new table,

Have a review on it and If any changes or modifications required I am ready to incorporate them

asr2003 commented 3 weeks ago

@ChuckHend Have a review on it in your free time

ChuckHend commented 2 weeks ago

Can you add a test or two that shows how the functionality will work and assert that it functions as expected?

asr2003 commented 1 week ago

Sure! I will update the tests