API calls that return large JSON objects can be filtered to just retrieve values since a specific date.
For example:
cohortdefinition - where coalesce(modifiedDate,createdDate) > 'YYYY-MM-DD'
cohortdefinition/{id}/info - where startTime > 'YYYY-MM-DD'
conceptset - where coalesce(modifiedDate,createdDate) > 'YYYY-MM-DD'
estimation - where coalesce(modifiedDate,createdDate) > 'YYYY-MM-DD'
ir - where coalesce(modifiedDate,createdDate) > 'YYYY-MM-DD'
Actual behavior
Although the APIs work OK as-is, they do not lend themselves to incremental loads. As the data volume grows, this becomes increasingly burdensome.
Enhancement Request
Add afterdate option to relevant GET requests to return just the subset of the results where the start/modified/created dates are after the specified date.
anthonysena
commented
5 months ago
Desired behavior
API calls that return large JSON objects can be filtered to just retrieve values since a specific date. For example:
Actual behavior
Although the APIs work OK as-is, they do not lend themselves to incremental loads. As the data volume grows, this becomes increasingly burdensome.
Enhancement Request
Add afterdate option to relevant GET requests to return just the subset of the results where the start/modified/created dates are after the specified date.