tim-finnigan
commented
3 months ago Thanks for reaching out. In the issue you linked someone mentioned that changing the base Docker image fixed this. Have you tried reproducing the issue in environments other than RHEL? Also the latest Boto3 is 1.34.118 per the CHANGELOG, have you tried updating to that version? And are you using the CRT and if so have you tried uninstalling/reinstalling?
You could also try testing with the various S3 transfer configuration options documented here, for example:
import boto3
from boto3.s3.transfer import TransferConfig
# Create an S3 client
s3 = boto3.client('s3')
# Define the transfer config
transfer_config = TransferConfig(
multipart_threshold=1024 * 25, # 25 MB
max_concurrency=10,
multipart_chunksize=1024 * 1024, # 1 MB
num_download_attempts=5,
max_io_queue=100,
io_chunksize=1024 * 1024, # 1 MB
use_threads=True
)
# Open the local file
with open('file.txt', 'rb') as f:
# Use the transfer config in an S3 upload operation
s3.upload_fileobj(
Fileobj=f,
Bucket='test-bucket',
Key='remote_file.txt',
Config=transfer_config
)
Otherwise I recommend following the S3 performance guideline optimizations documented here: https://docs.aws.amazon.com/AmazonS3/latest/userguide/optimizing-performance-guidelines.html
If you're able to narrow down the conditions in which this issue occurs, please let us know.
fitnycdigitalinitiatives
github-actions[bot]
Susuvnkl
Describe the bug
Hello,
We've recently run into a problem that seems a bit similar to #3657. Occasionally our application will stall out uploading objects to our bucket seemingly randomly using
upload_fileobjwithout returning an error. We've run this application for years without experience this issue, but recent changes have included upgrading boto3 to 1.33.2 and RHEL to 9 (not sure if relevant to the issue). As suggested in the related issue, we turned on the debug logs and here's an example when the upload just completely hangs for hours on end:As you can see it just hangs after the initial PUT. In successful uploads after the first PUT, there's
DEBUG 2024-05-28 19:33:05 s3transfer.utils:utils:release:645: Releasing acquire 0/NoneThere's nothing different about the files that it's failing on vs. the files it uploads without issue. The vast majority of uploads are successful. Just these occasional uploads stall without error.
Expected Behavior
Uploads should fail with an error.
Current Behavior
See above.
Reproduction Steps
Not able to reproduce, happens randomly when using upload_fileobj. The application uses this method:
Possible Solution
No response
Additional Information/Context
No response
SDK version used
boto3 1.33.2
Environment details (OS name and version, etc.)
rhel 9