search

Widen / tap-rest-api-msdk

`tap-rest-api-msdk` is a Singer tap for generic rest-apis, built with the Meltano SDK for Singer Taps.
Apache License 2.0
22 stars 25 forks source link

Understanding pagination #28

Open slamer59 opened 1 year ago

slamer59 commented 1 year ago

Hello, How to setup paginiation this is the response

{ "transactions": [{...}], "meta": { "current_page": 1, "next_page": 2, "prev_page": null, "total_pages": 3, "total_count": 210, "per_page": 100 } }

This is the next request query .. &PER_PAGE=20&CURRENT_PAGE=1

I have setup this :

      next_page_token_jsonpath: $.meta.next_page
      pagination_response_style: style1
      pagination_page_size: 100

It doesnot seems to work. What should I do ?

Is it always this kind of response ? 

"pagination": {
    "total": 136,
    "limit": 2,
    "offset": 2
}
s7clarke10 commented 1 year ago

Look at the documentation regarding this PR: https://github.com/Widen/tap-rest-api-msdk/pull/36. It may resolve you problem.