search

jupyter-server / jupyter_releaser

A set of helper scripts and GitHub Actions to aid in automated releases of Python and npm packages.
https://jupyter-releaser.readthedocs.io/en/latest/
Other
53 stars 66 forks source link

Source tar too large / drastically larger vs before jupyter releaser #592

Open andrii-i opened 5 hours ago

andrii-i commented 5 hours ago

Description

Looking for help in understanding why this happened and how to prevent it from happening during the next release.

During the Step 2: Publish Release of Jupyter Scheduler new release 2.10.0 Source Distribution upload failed due to PyPI source distributions size limits (~150 Mb) due to tar build being drastically larger in size vs before jupyter-releaser introduction. Built distribution upload went through, npm upload did not as it's later in the script.

By now 2.10.0 is fixed by building and uploading missing files manually but running jupyter-releaser build-python seems to produce the source of the same size >150 Mb (which causes PyPI size limit errors) vs up to 3 Mb before the jupyter-releaser was introduced. We need to avoid this happening in the the next release.

Reproduce

Expected behavior

Workflow does not fail, source distribution of the reasonable size is built and uploaded to PyPI, upload to npm happens.

Context

andrii-i commented 5 hours ago

For reference, here is the relevant log excerpt source distribution upload logs:

100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 152.0/152.0 MB • 00:03 • 62.2 MB/s
WARNING  Error during upload. Retry with the --verbose option for more details.
ERROR    HTTPError: 400 Bad Request from https://upload.pypi.org/legacy/
         File too large. Limit for project 'jupyter-scheduler' is 100 MB. See
         https://pypi.org/help/#file-size-limit for more information.

https://github.com/jupyter-server/jupyter-scheduler/actions/runs/11808986203/job/32898512565#step:5:373