search

dacort / duckdb-athena-extension

An experimental Athena extension for DuckDB 🐤
MIT License
49 stars 3 forks source link

Add pagination #2

Closed dacort closed 1 year ago

dacort commented 1 year ago

The initial implementation does not include pagination. 😢

lance has a good example of how this could be implemented. 

let batch = match crate::RUNTIME.block_on(async { (*(*init_data).stream).next().await }) {

Essentially we can create a stream using GetQueryResultsPaginator and have .next() called until no results are left.