search

vishesh-baghel / glide

You can see how Glidee-bot works by installing it from here
https://github.com/apps/glidee-bot
ISC License
0 stars 0 forks source link

Batch query on mindsDB is returning the same set of files again and again #38

Closed vishesh-baghel closed 8 months ago

vishesh-baghel commented 8 months ago

Currently on executing a batch query on mindsDB with only installationId as a parameter is returning the same set of files which is expected behaviour from the DB point of view.

But, the bot is overriding the updated predicted scores on the files which is unexpected behaviour. Their should be something to identify in the mindsDB table to make sure the bot gets new rows.

Check if pagination feature is present in mindsdb javascript sdk to solve this issue

vishesh-baghel commented 8 months ago

Since, pagination is not available yet in the mindsdb sdk, I decided to use simple query to fetch the predicted scores. I added parallel querying and updation logic to improve the performance of the job execution for the scheduler. This feature has been added in #35