celery / kombu

Messaging library for Python.
http://kombu.readthedocs.org/
BSD 3-Clause "New" or "Revised" License
2.88k stars 928 forks source link

Drop pycurl requirement #737

Closed ProTip closed 3 weeks ago

ProTip commented 7 years ago

Would it be possible to drop the pycurl requirement; at least when using SQS? I'm attempting to use this on AWS lambda however the pycurl version installed there complains about invalid opts and I'm having no luck bundling my own, newer version..

It appears to me that the SQS bits may have moved over to utilizing requests from boto3, but there are some legacy imports and methods hanging around in connection.py.

georgepsarakis commented 7 years ago

This should be possible. Do you have a stack trace from the error?

ProTip commented 7 years ago

I'm actually mistaken; pycurl is still buried pretty deep in there. It looks like boto3 is only used piecemeal for stuff like creating and signing requests. There is a TON of event loop and promise custom sauce going on that I did not realize.

Ideally pycurl would be swapped out with something like requests. There is another request for that here(in Celery, which I'm attempting to use): https://github.com/celery/celery/issues/3630 .

ppshobi commented 6 years ago

Any progress on this?

auvipy commented 6 years ago

not a high prio right at the moment. will be in version 6 for sure.

spawn-guy commented 1 month ago

not only pycurl is required, but also openssl version of that. i've been struggling with that on aws elastic beanstalk Amazon Linux 2 with py3.8.. and now as im migrating to py3.11 - this is still a problem.

@auvipy i'd like to volunteer to remove the dependency(as i have some budget left in my awesome boss). what should i know? looks like botocore requires urllib3 https://github.com/boto/botocore/blob/develop/setup.py#L31

spawn-guy commented 1 month ago

do we need Proxy Support? ;) and more precisely: Proxy support on a "per-request" basis?

where can i find a list of (at least public) projects that depend directly on kombu?

auvipy commented 3 weeks ago

we have this for v5.5