Airtable's listRecords API has a paginated response, with a max PageSize of 100, however we have a growing list of models in the model-hub and therefore a larger number of models than Airtable API's max PageSize. Our workflow to read from Airtable API and dump it into a public models.json in our S3 currently does not iterate over the paginated response from the API.
Objective(s)
[ ] Iterate over the paginated response and retrieve all the models from the Airtable database.
Summary
Airtable's
listRecordsAPI has a paginated response, with a max PageSize of 100, however we have a growing list of models in the model-hub and therefore a larger number of models than Airtable API's max PageSize. Our workflow to read from Airtable API and dump it into a publicmodels.jsonin our S3 currently does not iterate over the paginated response from the API.Objective(s)
Documentation
https://airtable.com/developers/web/api/list-records