nextstrain / nextstrain.org

The Nextstrain website
https://nextstrain.org
GNU Affero General Public License v3.0
87 stars 49 forks source link

`collect-dataset` and `collect-search-results` returning empty datasets #670

Closed joverlee521 closed 10 months ago

joverlee521 commented 1 year ago

Current Behavior

Scripts collect-dataset and collect-search-results, which collect dataset info from the nextstrain-data AWS S3 bucket return empty arrays for datasets. (See example in our scheduled GH Actions.)

This is resulting in an empty dataset list at https://nextstrain.org/influenza/ and empty search list at https://nextstrain.org/search/sars-cov-2.

I noticed the empty results when I was running collect-search-results manually for seasonal flu data.

joverlee521 commented 1 year ago

Ah, the returned s3Objects is truncated, but we are not catching it in the script because the property should be IsTruncated instead of isTruncated.

joverlee521 commented 10 months ago

Both scripts were removed in https://github.com/nextstrain/nextstrain.org/pull/694