thunderstore-io / Thunderstore

Thunderstore is a mod database and API for downloading mods. Thunderstore Discord: https://discord.thunderstore.io/
https://thunderstore.io/
GNU Affero General Public License v3.0
134 stars 27 forks source link

Add automatic file tree extraction on upload #876

Closed MythicManiac closed 1 year ago

MythicManiac commented 1 year ago

Automatically extract the file tree of new package uploads as they're processed.

This can lead to a potential issue with submission processing time taking much longer than before, and as it's handled synchronously, it could lead to an increase in submission failures for large packages.

There's no way to fix the above issue without moving to an entirely asynchronous submission processing, which is a task too large to take on currently.

codecov[bot] commented 1 year ago

Codecov Report

Patch coverage: 89.47% and no project coverage change.

Comparison is base (517b358) 92.18% compared to head (3a1b508) 92.19%.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## package-filelist #876 +/- ## ================================================= Coverage 92.18% 92.19% ================================================= Files 264 265 +1 Lines 7547 7556 +9 Branches 719 719 ================================================= + Hits 6957 6966 +9 Misses 491 491 Partials 99 99 ``` | [Files Changed](https://app.codecov.io/gh/thunderstore-io/Thunderstore/pull/876?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=thunderstore-io) | Coverage Δ | | |---|---|---| | [django/thunderstore/repository/filetree.py](https://app.codecov.io/gh/thunderstore-io/Thunderstore/pull/876?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=thunderstore-io#diff-ZGphbmdvL3RodW5kZXJzdG9yZS9yZXBvc2l0b3J5L2ZpbGV0cmVlLnB5) | `86.66% <86.66%> (ø)` | | | [django/thunderstore/repository/package\_upload.py](https://app.codecov.io/gh/thunderstore-io/Thunderstore/pull/876?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=thunderstore-io#diff-ZGphbmdvL3RodW5kZXJzdG9yZS9yZXBvc2l0b3J5L3BhY2thZ2VfdXBsb2FkLnB5) | `83.05% <100.00%> (+0.29%)` | :arrow_up: | | [django/thunderstore/repository/tasks/files.py](https://app.codecov.io/gh/thunderstore-io/Thunderstore/pull/876?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=thunderstore-io#diff-ZGphbmdvL3RodW5kZXJzdG9yZS9yZXBvc2l0b3J5L3Rhc2tzL2ZpbGVzLnB5) | `100.00% <100.00%> (+6.45%)` | :arrow_up: |

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.