HumanCellAtlas / data-store

Design specs and prototypes for the HCA Data Storage System (DSS, "blue box")
https://dss.staging.data.humancellatlas.org/
Other
40 stars 6 forks source link

500 ISE in PUT bundle #1617

Open kislyuk opened 6 years ago

kislyuk commented 6 years ago
put https://dss.dev.data.humancellatlas.org/v1/bundles/ebe181e1-178e-4e96-a04f-fb66ffddb59c {'json': {'files': [{'uuid': '2534694a-e866-416b-a5b5-20ef3c51b54d', 'version': '2018-09-28T180930.196052Z', 'name': 'EZL5WB3E', 'indexed': False}, {'uuid': 'b49228e2-b9b9-4809-a93d-3edeca685ffa', 'version': '2018-09-28T180929.926331Z', 'name': '9GDJQD4T', 'indexed': False}, {'uuid': 'c827164a-d4c2-4e2b-a4e8-3d89563f27ef', 'version': '2018-09-28T180930.196260Z', 'name': 'XQUPM7DZ', 'indexed': False}, {'uuid': 'ff5c4d44-ee90-4e55-9fa4-1cdd2af7a200', 'version': '2018-09-28T180930.109853Z', 'name': 'ZBASUBRP', 'indexed': False}], 'creator_uid': 1}, 'params': {'version': '2018-09-28T18:10:28.297585', 'replica': 'aws'}}
<Response [201]>
{
    "version": "2018-09-28T181028.297585Z"
}
get https://dss.dev.data.humancellatlas.org/v1/bundles/ebe181e1-178e-4e96-a04f-fb66ffddb59c {'params': {'version': '2018-09-28T181028.297585Z', 'replica': 'aws'}}
<Response [500]>
{
  "detail": "None is not of type 'string'\n\nFailed validating 'type' in schema['properties']['bundle']['properties']['files']['items']['properties']['content-type']:\n    {'description': 'Content-type of the file.', 'type': 'string'}\n\nOn instance['bundle']['files'][0]['content-type']:\n    None",
  "status": 500,
  "title": "Response body does not conform to specification",
  "type": "about:blank"
}

Bundle was put on AWS when files were uploaded on GCP, but this seems like a general response formatting problem

kozbo commented 6 years ago

@parthshahva is this a problem with the uploader? Does the uploader stage files to GCP?

parthshahva commented 6 years ago

This has nothing to do with the upload service

kozbo commented 5 years ago

How is this problem reproduced? How often does it happen? What are the repercussions? how critical is this problem?

Break into two phases?