elliotgao2 / gain

Web crawling framework based on asyncio.
GNU General Public License v3.0
2.04k stars 207 forks source link

bug #48

Open luotom opened 5 years ago

luotom commented 5 years ago

When accessing the 404 page, the url will be accessed all the time.