dandi / dandisets

735 Dandisets, 812.2 TB total. DataLad super-dataset of all Dandisets from https://github.com/dandisets
10 stars 0 forks source link

Set superdataset description using `dandi.stats` regardless of what Dandisets were operated on #332

Closed jwodder closed 1 year ago

jwodder commented 1 year ago

Closes #331.

codecov[bot] commented 1 year ago

Codecov Report

Base: 75.62% // Head: 75.64% // Increases project coverage by +0.02% :tada:

Coverage data is based on head (9d9b00c) compared to base (eb94a6f). Patch coverage: 26.66% of modified lines in pull request are covered.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## draft #332 +/- ## ========================================== + Coverage 75.62% 75.64% +0.02% ========================================== Files 14 14 Lines 2433 2435 +2 Branches 383 383 ========================================== + Hits 1840 1842 +2 - Misses 439 440 +1 + Partials 154 153 -1 ``` | [Impacted Files](https://codecov.io/gh/dandi/dandisets/pull/332?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=dandi) | Coverage Δ | | |---|---|---| | [tools/backups2datalad/datasetter.py](https://codecov.io/gh/dandi/dandisets/pull/332?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=dandi#diff-dG9vbHMvYmFja3VwczJkYXRhbGFkL2RhdGFzZXR0ZXIucHk=) | `76.53% <26.66%> (-0.87%)` | :arrow_down: | | [tools/backups2datalad/zarr.py](https://codecov.io/gh/dandi/dandisets/pull/332?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=dandi#diff-dG9vbHMvYmFja3VwczJkYXRhbGFkL3phcnIucHk=) | `72.65% <0.00%> (+0.27%)` | :arrow_up: | | [tools/backups2datalad/asyncer.py](https://codecov.io/gh/dandi/dandisets/pull/332?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=dandi#diff-dG9vbHMvYmFja3VwczJkYXRhbGFkL2FzeW5jZXIucHk=) | `79.00% <0.00%> (+0.27%)` | :arrow_up: | | [tools/backups2datalad/\_\_main\_\_.py](https://codecov.io/gh/dandi/dandisets/pull/332?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=dandi#diff-dG9vbHMvYmFja3VwczJkYXRhbGFkL19fbWFpbl9fLnB5) | `63.86% <0.00%> (+0.42%)` | :arrow_up: | Help us with your feedback. Take ten seconds to tell us [how you rate us](https://about.codecov.io/nps?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=dandi). Have a feature suggestion? [Share it here.](https://app.codecov.io/gh/feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=dandi)

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

yarikoptic commented 1 year ago

FWIW, I did a run of 000108 backup, which was super quick - around 7 seconds (I guess changes stopped pouring in), and dandisets description is now talking about , 425.9 TB total which is great and close (I wonder why difference but will not sweat about it for now) to 449 TB stated on https://dandiarchive.org/. So it worked out nicely on the top dandiset level at least. Thanks @jwodder