uktrade / public-data-api

The source for the Department for International Trade's Public Data API
https://data.api.trade.gov.uk/
MIT License
5 stars 1 forks source link

[Urgent] Dataset Tables Erroring #233

Open sigmacraig opened 4 months ago

sigmacraig commented 4 months ago

Our integration with the data API has been reporting errors this morning, as dataset tables under the latest version (v4.0.269) are throwing an error on attempting to access them.

For example, attempting to pull a CSV of commodity measures via https://data.api.trade.gov.uk/v1/datasets/uk-tariff-2021-01-01/versions/v4.0.269/tables/measures-on-declarable-commodities/data?format=csv results in the following:

`<?xml version="1.0" encoding="UTF-8"?>

NoSuchKeyThe specified key does not exist.uk-tariff-2021-01-01/v4.0.269/tables/measures-on-declarable-commodities/data.csvY5H3WEKY1GBDE0C7ypmd45sGXEhHwI4PFd8shgUg5shAK4o9UnjfZfv5kUxbFrL+nI/iQAf6eA2FDNpJcHV+nOZifjc=` The prior version seems to be working fine and I can fetch results for it.
SteveCN7 commented 4 months ago

Morning, can I just check the versioning you're looking for, our latest published version appears to be v4.0.246, not v4.0.269 We have had an intermittent fault with some data not writing correctly which we're currently investigating

sigmacraig commented 4 months ago

Morning Steve, we've pulled v4.0.269 from the following: https://data.api.trade.gov.uk/v1/datasets/uk-tariff-2021-01-01/versions?format=json

SteveCN7 commented 4 months ago

Thanks, we're going to look into this now for you

sigmacraig commented 4 months ago

Bril, thanks for confirming

SteveCN7 commented 4 months ago

Hi, v4.0.269 now appears to be loading data correctly, we think there was a pipeline delay somewhere which we're still in the process of debugging. We'll keep this issue open until we establish and fix the root cause

sigmacraig commented 4 months ago

Thanks Steve, can confirm that version's looking good this side. Will leave this open and await to hear on the ongoing solution.

sigmacraig commented 4 months ago

Morning Steve, just to make you aware we've seen the same issue as above occur on v4.0.275 today.