Support paginating REST API input

[imrehg]

Many REST APIs return paginated data to make data queries more manageable. It's not obvious to me if if it's possible to implement that pagination through the current GUI.

This is potentially a big piece of work, as there are quite a few common pagination patterns, but that input type is pretty limited in use without any sort of pagination.

Here's some example or inspiration from the Airbyte docs that had to implement these already as well: Pagination Strategies

[tgourdel]

Thanks @imrehg, you're right pagination is not supported yet. It's not easy to support it well as there are different pagination types and many edge cases. It's definitely something that will have to be possible at some point in the tool. May I ask what kind of APIs you were thinking? Broad SaaS apps connectivity is currently not a focus for Amphi, as many great tools (such as Airbyte) already address this pretty well.

[unboiled]

May I suggest looking at ADF for inspiration? This covers most of my paginated REST requirements. https://learn.microsoft.com/en-us/azure/data-factory/connector-rest?tabs=data-factory#pagination-support