search

apache / drill

Apache Drill is a distributed MPP query layer for self describing data
https://drill.apache.org/
Apache License 2.0
1.93k stars 980 forks source link

DRILL-8437: Add Header Index Pagination #2806

Closed cgivre closed 1 year ago

cgivre commented 1 year ago

DRILL-8437: Add Header Index Pagination

Description

See below

Documentation

Updated README.

Header Index Pagination

Header index pagination is used when the API in question returns a link to the next page in the response header. Shopify is one such example of an API that does this.

The only configuration option is the nextPageParam which is the parameter that Drill should look for in the response header.

 "paginator": {
        "nextPageParam": "page",
        "method": "HEADER_INDEX"
      }

Testing

Added UT and manually tested with Shopify API.