TanguyLe / MagicPriceUpdater

Utility to update the price of MTG cards on Card Market.
MIT License
0 stars 1 forks source link

Speed improvement of Card Market extraction #6

Open TanguyLe opened 3 years ago

TanguyLe commented 3 years ago

It would be by using httpx and async http requests within the workers: https://medium.com/swlh/how-to-boost-your-python-apps-using-httpx-and-asynchronous-calls-9cfe6f63d6ad

NB: The current workers receive requests to perform by chunks of 10 from concurrent futures, could be optimized with some benchmarking I guess, but it heavily depends on the Card Market service so it's hard to bench.