Closed jeffhuth-bytecode closed 4 years ago
Change from offset to cursor pagination in sync.py. Add rate limit decorator to client.py.
offset
cursor
sync.py
client.py
Ran singer-discover, singer-check-tap, and target-stitch (initial load and incremental).
Low - removes potential 10,000 limit and possible infinite loop w/ offset pagination. Tested multiple pages but not with large data volumes.
Revert to 0.3.0
Description of change
Change from
offsettocursorpagination insync.py. Add rate limit decorator toclient.py.Manual QA steps
Ran singer-discover, singer-check-tap, and target-stitch (initial load and incremental).
Risks
Low - removes potential 10,000 limit and possible infinite loop w/ offset pagination. Tested multiple pages but not with large data volumes.
Rollback steps
Revert to 0.3.0