UKHSA-Internal / coronavirus-dashboard-api-python-sdk

Coronavirus (COVID-19) in the UK - API Service SDK for Python
https://coronavirus.data.gov.uk/
MIT License
67 stars 18 forks source link

API performance issues #22

Closed dbrennand closed 4 years ago

dbrennand commented 4 years ago

Today I have been experiencing poor performance from the API.

The API has become slow and is returning status 500 internal server error.

Here is the error response and activityId:

Response .......... { "statusCode": 500, "message": "Internal server error", "activityId": "3ef0d497-18c5-47ff-9e1a-3f91cc6c0c6d" }

Full error response:

Request failed .... 500 - Internal Server Error
Response .......... { "statusCode": 500, "message": "Internal server error", "activityId": "3ef0d497-18c5-47ff-9e1a-3f91cc6c0c6d" }
URL ............... https://api.coronavirus.data.gov.uk/v1/data?filters=areaType%3Dnation&structure=%7B%22date%22%3A%22date%22%2C%22name%22%3A%22areaName%22%2C%22code%22%3A%22areaCode%22%2C%22stats%22%3A%7B%22cases%22%3A%7B%22New+cases%22%3A%7B%22value%22%3A%22newCasesByPublishDate%22%7D%2C%22Cumulative+cases%22%3A%7B%22value%22%3A%22cumCasesByPublishDate%22%7D%2C%22Hospital+cases%22%3A%7B%22value%22%3A%22hospitalCases%22%7D%2C%22COVID-19+occupied+beds+with+mechanical+ventilators%22%3A%7B%22value%22%3A%22covidOccupiedMVBeds%22%7D%7D%2C%22deaths%22%3A%7B%22Daily+deaths%22%3A%7B%22value%22%3A%22newDeaths28DaysByDeathDate%22%7D%2C%22Cumulative+deaths%22%3A%7B%22value%22%3A%22cumDeaths28DaysByDeathDate%22%7D%7D%2C%22admissions%22%3A%7B%22New+admissions%22%3A%7B%22value%22%3A%22newAdmissions%22%7D%2C%22Cumulative+admissions%22%3A%7B%22value%22%3A%22cumAdmissions%22%7D%7D%2C%22tests%22%3A%7B%22New+pillar+one+tests+by+publish+date%22%3A%7B%22metadata%22%3A%22Pillar+1+%28NHS+and%2C+in+England%2C+PHE%29%22%2C%22value%22%3A%22newPillarOneTestsByPublishDate%22%7D%2C%22Cumulative+pillar+one+tests+by+publish+date%22%3A%7B%22metadata%22%3A%22Pillar+1+%28NHS+and%2C+in+England%2C+PHE%29%22%2C%22value%22%3A%22cumPillarOneTestsByPublishDate%22%7D%2C%22New+pillar+two+tests+by+publish+date%22%3A%7B%22metadata%22%3A%22Pillar+2+%28Commercial+partners%29%22%2C%22value%22%3A%22newPillarTwoTestsByPublishDate%22%7D%2C%22Cumulative+pillar+two+tests+by+publish+date%22%3A%7B%22metadata%22%3A%22Pillar+2+%28Commercial+partners%29%22%2C%22value%22%3A%22cumPillarTwoTestsByPublishDate%22%7D%2C%22New+pillar+three+tests+by+publish+date%22%3A%7B%22metadata%22%3A%22Pillar+3+%28Antibody%29%22%2C%22value%22%3A%22newPillarThreeTestsByPublishDate%22%7D%2C%22Cumulative+pillar+three+tests+by+publish+date%22%3A%7B%22metadata%22%3A%22Pillar+3+%28Antibody%29%22%2C%22value%22%3A%22cumPillarThreeTestsByPublishDate%22%7D%2C%22New+pillar+four+tests+by+publish+date%22%3A%7B%22metadata%22%3A%22Pillar+4+%28Surveillance%29%22%2C%22value%22%3A%22newPillarFourTestsByPublishDate%22%7D%2C%22Cumulative+pillar+four+tests+by+publish+date%22%3A%7B%22metadata%22%3A%22Pillar+4+%28Surveillance%29%22%2C%22value%22%3A%22cumPillarFourTestsByPublishDate%22%7D%7D%7D%7D&latestBy=newCasesByPublishDate&format=json&page=1
Decoded URL ....... https://api.coronavirus.data.gov.uk/v1/data?filters=areaType=nation&structure={"date":"date","name":"areaName","code":"areaCode","stats":{"cases":{"New+cases":{"value":"newCasesByPublishDate"},"Cumulative+cases":{"value":"cumCasesByPublishDate"},"Hospital+cases":{"value":"hospitalCases"},"COVID-19+occupied+beds+with+mechanical+ventilators":{"value":"covidOccupiedMVBeds"}},"deaths":{"Daily+deaths":{"value":"newDeaths28DaysByDeathDate"},"Cumulative+deaths":{"value":"cumDeaths28DaysByDeathDate"}},"admissions":{"New+admissions":{"value":"newAdmissions"},"Cumulative+admissions":{"value":"cumAdmissions"}},"tests":{"New+pillar+one+tests+by+publish+date":{"metadata":"Pillar+1+(NHS+and,+in+England,+PHE)","value":"newPillarOneTestsByPublishDate"},"Cumulative+pillar+one+tests+by+publish+date":{"metadata":"Pillar+1+(NHS+and,+in+England,+PHE)","value":"cumPillarOneTestsByPublishDate"},"New+pillar+two+tests+by+publish+date":{"metadata":"Pillar+2+(Commercial+partners)","value":"newPillarTwoTestsByPublishDate"},"Cumulative+pillar+two+tests+by+publish+date":{"metadata":"Pillar+2+(Commercial+partners)","value":"cumPillarTwoTestsByPublishDate"},"New+pillar+three+tests+by+publish+date":{"metadata":"Pillar+3+(Antibody)","value":"newPillarThreeTestsByPublishDate"},"Cumulative+pillar+three+tests+by+publish+date":{"metadata":"Pillar+3+(Antibody)","value":"cumPillarThreeTestsByPublishDate"},"New+pillar+four+tests+by+publish+date":{"metadata":"Pillar+4+(Surveillance)","value":"newPillarFourTestsByPublishDate"},"Cumulative+pillar+four+tests+by+publish+date":{"metadata":"Pillar+4+(Surveillance)","value":"cumPillarFourTestsByPublishDate"}}}}&latestBy=newCasesByPublishDate&format=json&page=1
Parameters:
{ 'filters': 'areaType=nation',
  'format': 'json',
  'latestBy': 'newCasesByPublishDate',
  'page': 1,
  'structure': '{"date":"date","name":"areaName","code":"areaCode","stats":{"cases":{"New '
               'cases":{"value":"newCasesByPublishDate"},"Cumulative '
               'cases":{"value":"cumCasesByPublishDate"},"Hospital '
               'cases":{"value":"hospitalCases"},"COVID-19 occupied beds with '
               'mechanical '
               'ventilators":{"value":"covidOccupiedMVBeds"}},"deaths":{"Daily '
               'deaths":{"value":"newDeaths28DaysByDeathDate"},"Cumulative '
               'deaths":{"value":"cumDeaths28DaysByDeathDate"}},"admissions":{"New '
               'admissions":{"value":"newAdmissions"},"Cumulative '
               'admissions":{"value":"cumAdmissions"}},"tests":{"New pillar '
               'one tests by publish date":{"metadata":"Pillar 1 (NHS and, in '
               'England, '
               'PHE)","value":"newPillarOneTestsByPublishDate"},"Cumulative '
               'pillar one tests by publish date":{"metadata":"Pillar 1 (NHS '
               'and, in England, '
               'PHE)","value":"cumPillarOneTestsByPublishDate"},"New pillar '
               'two tests by publish date":{"metadata":"Pillar 2 (Commercial '
               'partners)","value":"newPillarTwoTestsByPublishDate"},"Cumulative '
               'pillar two tests by publish date":{"metadata":"Pillar 2 '
               '(Commercial '
               'partners)","value":"cumPillarTwoTestsByPublishDate"},"New '
               'pillar three tests by publish date":{"metadata":"Pillar 3 '
               '(Antibody)","value":"newPillarThreeTestsByPublishDate"},"Cumulative '
               'pillar three tests by publish date":{"metadata":"Pillar 3 '
               '(Antibody)","value":"cumPillarThreeTestsByPublishDate"},"New '
               'pillar four tests by publish date":{"metadata":"Pillar 4 '
               '(Surveillance)","value":"newPillarFourTestsByPublishDate"},"Cumulative '
               'pillar four tests by publish date":{"metadata":"Pillar 4 '
               '(Surveillance)","value":"cumPillarFourTestsByPublishDate"}}}}'}