[bug] Take over 40 mins to upload small files

Vickywwww commented 11 months ago

What happened?

Using actions/upload-artifact@v3, it took us 48 mins to upload the Artifact that only contains 211 files and the The raw size of all the files that were specified for upload is 3986545 bytes.

Total file count: 211 ---- Processed file #201 (95.2%)
Total file count: 211 ---- Processed file #201 (95.2%)
A 503 status code has been received, will attempt to retry the upload
Exponential backoff for retry #1. Waiting for 6080 milliseconds before continuing the upload at offset 0
Total file count: 211 ---- Processed file #201 (95.2%)
Finished backoff for retry #1, continuing with upload
Total file count: 211 ---- Processed file #204 (96.6%)
Total file count: 211 ---- Processed file #204 (96.6%)
A 503 status code has been received, will attempt to retry the upload
Exponential backoff for retry #1. Waiting for 4653 milliseconds before continuing the upload at offset 0
Total file count: 211 ---- Processed file #204 (96.6%)
Finished backoff for retry #1, continuing with upload
Total file count: 211 ---- Processed file #210 (99.5%)
Total file count: 211 ---- Processed file #210 (99.5%)
Total file count: 211 ---- Processed file #210 (99.5%)
Total file count: 211 ---- Processed file #210 (99.5%)
Total file count: 211 ---- Processed file #210 (99.5%)
Total file count: 211 ---- Processed file #210 (99.5%)
Total file count: 211 ---- Processed file #210 (99.5%)
Total file count: 211 ---- Processed file #210 (99.5%)
A 503 status code has been received, will attempt to retry the upload
Exponential backoff for retry #1. Waiting for 5941 milliseconds before continuing the upload at offset 0
Finished backoff for retry #1, continuing with upload
Total size of all the files uploaded is 1970496 bytes
File upload process has finished. Finalizing the artifact upload
Artifact has been finalized. All files have been successfully uploaded!

The raw size of all the files that were specified for upload is 3986545 bytes
The size of all the files that were uploaded is 1970496 bytes. This takes into account any gzip compression used to reduce the upload size, time and storage

Note: The size of downloaded zips can differ significantly from the reported size. For more information see: https://github.com/actions/upload-artifact#zipped-artifact-downloads 

Artifact **-**-** has been successfully uploaded!

What did you expect to happen?

Artifact should be uploaded in few seconds, we ran same code 5 days ago, here is the log:

Run actions/upload-artifact@v3
With the provided path, there will be 211 files uploaded
Starting artifact upload
For more detailed logs during the artifact upload process, enable step-debugging: https://docs.github.com/actions/monitoring-and-troubleshooting-workflows/enabling-debug-logging#enabling-step-debug-logging
Artifact name is valid!
Container for artifact "*******" successfully created. Starting upload of file(s)
Total file count: 211 ---- Processed file #61
Total file count: 211---- Processed file #[12] 5 (59.2%)
Total file count: 211 ---- Processed file #[18] 5 (87.6%)
Total size of all the files uploaded is 70465 bytes
File upload process has finished. Finalizing the artifact upload
Artifact has been finalized. All files have been successfully uploaded!

The raw size of all the files that were specified for upload is 3986507 bytes
The size of all the files that were uploaded is 1970465 bytes. This takes into account any gzip compression used to reduce the upload size, time and storage

Note: The size of downloaded zips can differ significantly from the reported size. For more information see: https://github.com/actions/upload-artifact#zipped-artifact-downloads 

Artifact **-**-** has been successfully uploaded!

How can we reproduce it?

run actions/upload-artifact@v3 on github actions runner ubuntu-latest

Anything else we need to know?

No response

What version of the action are you using?

actions/upload-artifact@v3

What are your runner environments?

linux

Are you on GitHub Enterprise Server? If so, what version?

No response

screig commented 11 months ago

https://github.com/actions/upload-artifact/issues/199

This issue ticket has been open since 2021, which details the same issue. The speed of this action and therefore the whole GitHub CI platform is a joke.