dolthub / dolthub-issues

Issues for dolthub.com
https://dolthub.com
4 stars 1 forks source link

Add query as a Job #503

Closed coffeegoddd closed 9 months ago

coffeegoddd commented 11 months ago

Add option for DoltHub users to run a query as a Job. This Job will execute the query out-of-band and upload the results to a location where the user can then download/stream the results. Results can be formatted as CSV or SQL.

The results should be available to users for a short period of time (24 hours), and each user is limited to 3 query Jobs that consume storage at a time. This limit will be increased for DoltHub Pro members.

This feature will also need to be on DoltLab, and allow DoltLab Enterprise customers to configure their own limits.