search

celery / kombu

Messaging library for Python.
http://kombu.readthedocs.org/
BSD 3-Clause "New" or "Revised" License
2.87k stars 928 forks source link

asyncio eventloop support #879

Open Roger opened 6 years ago

Roger commented 6 years ago

I know that there's this example that use Hub, that it's a partial implementation of tulip https://github.com/celery/kombu/blob/master/examples/experimental/async_consume.py but, is there any support to run consumers using the asyncio event loop?

thedrow commented 6 years ago

Yes, in 6.0 everything will be async by default.

pembeci commented 6 years ago

@thedrow that's good to hear. Any idea, when 5.0 will arrive? I checked 5.0dev branch and latest commit was 18 months ago. Is it in active development? Thanks.

pembeci commented 6 years ago

@Roger did you try that experimental Hub approach in a real project? I wonder if it is good enough for using in production.

auvipy commented 6 years ago

no not in active development. we have the plan to focus on this after releasing celery 4.3, maybe after October 30.

andreyrusanov commented 5 years ago

@auvipy any updates on this? Did you, guys. have a chance to start work on it?

auvipy commented 5 years ago

i'm planning to start working on this in new year

thogar-computer commented 4 years ago

@auvipy has there been any progress on 5.0?

auvipy commented 4 years ago

yes

whg517 commented 3 years ago

Hello, @auvipy . I would like to ask how far support for asynchrony is going.

At the current time node, Python support for asynchrony is very common. As things stand:

The release of ASGI has spurred the rapid development of asynchronous Web frameworks.

For example:

Mainstream frameworks are already adapting to async/await, which shows that async/await is a trend.

I see this issue being raised a long time ago and the corresponding PR is still in draft stage. I would like to know if there are any new development plans for work that supports asynchrony, or if there are specific development tasks. I would like to consider whether asynchrony is supported in the process of technology selection in the future. Because my new projects are written based on asynchrony.

auvipy commented 3 years ago

Hello, @auvipy . I would like to ask how far support for asynchrony is going.

At the current time node, Python support for asynchrony is very common. As things stand:

The release of ASGI has spurred the rapid development of asynchronous Web frameworks.

For example:

* Django has already enabled async by default in [3.0](https://docs.djangoproject.com/en/3.2/releases/3.0/#asgi-support)

* The power of the [Fastapi](https://fastapi.tiangolo.com/) has attracted many developers who are using Flask.

* [SqlAlchemy 1.4](https://docs.sqlalchemy.org/en/14/orm/extensions/asyncio.html) also redesigned the kernel and began to support asynchronous calls.

* Scrapy is written in Twisted, and although both are asynchronous, [async/await](https://docs.scrapy.org/en/latest/topics/asyncio.html) writing is also being supported to make it easier for developers to write functions.

Mainstream frameworks are already adapting to async/await, which shows that async/await is a trend.

I see this issue being raised a long time ago and the corresponding PR is still in draft stage. I would like to know if there are any new development plans for work that supports asynchrony, or if there are specific development tasks. I would like to consider whether asynchrony is supported in the process of technology selection in the future. Because my new projects are written based on asynchrony.

I got married after I start that. now after one years of different ups and downs I am planning to start working on that soon. initially basic async work on py-amqp and kombu and also probably a 3rd party async driver like redis to start the PoC. and a related implementation design docs. I was also follwing the approach taken by django and sqlalchemy. so keep me asking questions on this regard. I would be happy with that. I have some rough ideas right now, you could tell those, half backed. when we will try to create PoC, we can figure out some more detail. thanks for raising this again

ZoranPavlovic commented 2 years ago

Is there any update perhaps on the state of async support in Kombu? Which issue should I monitor for its progress?

auvipy commented 2 years ago

follow this issue, also if possible fund the effort

GregoirePelegrin commented 1 year ago

Hi! No particular update on this matter? Thanks a lot for the hard work!

omer9564 commented 5 months ago

Any update on this ? Is there any branch / draft PR that one could help contribute to ?