[FEATURE] Utilize uvloop in batches to avoid using threads for domain name resolution - Githubissues

BoostryJP / ibet-Prime

Advanced API Toolkit for Digital Securities Issuance and Management on the ibet Network 🚀

https://ibet.jp/ibet-for-fin

Apache License 2.0

11 stars 1 forks source link

[FEATURE] Utilize uvloop in batches to avoid using threads for domain name resolution #595

Closed purplesmoke05 closed 8 months ago

purplesmoke05 commented 8 months ago

Is your feature request related to a problem? Please describe.

Currently, all batches are written in async way but some web3 call uses multi thread because aiohttp depended by web3 resolves domain name using getaddrinfo which calls Thread.run.
To reduce thread overhead, we want to introduce uvloop, which allows getaddrinfo to be executed without threading.
- https://github.com/MagicStack/uvloop/blob/v0.19.0/uvloop/loop.pyx#L892-L932

Describe the solution you'd like

Utilize uvloop in batches to avoid using threads for domain name resolution.

purplesmoke05 commented 8 months ago

In order to make aiohttp Session cache thread-safe, web3 uses exclusion control on a single separate thread. This cannot be removed.

https://github.com/ethereum/web3.py/blob/v6/web3/_utils/request.py#L129-L141 https://github.com/ethereum/web3.py/blob/v6/web3/_utils/async_caching.py#L13