duxbuse / ninthage-data-analytics

A better way for the project to ingest tournament results
GNU General Public License v3.0
1 stars 0 forks source link

Define field to determine incremental refresh on Tableau #184

Open SanderND opened 1 year ago

SanderND commented 1 year ago

The extract of all data in Tableau is becoming big and is taking some minutes while also GCS resources are spent. Tableau supports an incremental refresh but I need a date or timestamp field, or a unique ID that increases. Im not sure if GAME_ID qualifies for this. If not, we need a timestamp field based on the creation of the records on GCS.