populationgenomics / analysis-runner

MIT License
2 stars 4 forks source link

Fix zip_to_zenodo.py blob prefix for subsets with common initial prefixes #710

Closed jmarshall closed 3 weeks ago

jmarshall commented 3 weeks ago

Small bug fix followup to PR #709: If the bucket contains files in foo/XY/** and foo/XYZ/** then requesting prefix=".../foo" and subset="XY" was adding the files under both XY/** and XYZ/**. Add a trailing '/' to list_blobs() to prevent this.

Also spam the logs less by only logging every hundredth file after the first hundred.