Aghababaei / PhD-Seeker

Finding latest fully funded PhD positions for international students through web scraping
GNU General Public License v3.0
84 stars 11 forks source link

Asynchronous url fetch #5

Closed javadr closed 2 years ago

javadr commented 2 years ago

This PR implements an asynchronous version resulting in time savings. Actually, it fetches all the pages simultaneously. In the old version, a search cost at least 30 seconds while in this new version it just takes 5 seconds. The only caveat is its dependency on two new modules: http3 and 'httpx`.

Aghababaei commented 2 years ago

Dear @javadr Thank you very much for your contribution.