search

duxbuse / ninthage-data-analytics

A better way for the project to ingest tournament results
GNU General Public License v3.0
1 stars 0 forks source link

New Recuit interface doesnt function #204

Open SanderND opened 6 months ago

SanderND commented 6 months ago

In december 2023 no ingestion of the new recruit data was done.

To check this try this code, which counts the number of ingested distinct army_id's per month in 2023 from the New Recruit datasource.

SELECT data_source, count(distinct army_uuid) as number_of_army_id, extract (year from ingest_date) as year, extract (month from ingest_date) as month, FROM ninthage-data-analytics.list_data.tournament_lists where extract (year from ingest_date) = 2023 and data_source = "NEW_RECRUIT" GROUP BY year, month, data_source

SanderND commented 6 months ago

The import of januari 2024 also failed as this query: SELECT GameID, IngestDate FROM ninthage-data-analytics.Staging.stg_listdata where DataSource = "NEW_RECRUIT" and extract (year from IngestDate) = 2024 group by 1, 2 LIMIT 1000

does not show me any results.