Closed mygithub-acct closed 3 years ago
Run with lncrawl -lll
It will print some extra logs.
Can you share those logs?
Run with
lncrawl -lll
It will print some extra logs. Can you share those logs?================================================================================ ╭╮╱╱╱╱╱╱╭╮╱╭╮╱╱╱╱╱╱╱╱╱╱╱╱╭╮╱╭━━━╮╱╱╱╱╱╱╱╱╱╭╮ ┃┃╱╱╱╱╱╱┃┃╭╯╰╮╱╱╱╱╱╱╱╱╱╱╱┃┃╱┃╭━╮┃╱╱╱╱╱╱╱╱╱┃┃ ┃┃╱╱╭┳━━┫╰┻╮╭╋━╮╭━━┳╮╭┳━━┫┃╱┃┃╱╰╋━┳━━┳╮╭╮╭┫┃╭━━┳━╮ ┃┃╱╭╋┫╭╮┃╭╮┃┃┃╭╮┫╭╮┃╰╯┃┃━┫┃╱┃┃╱╭┫╭┫╭╮┃╰╯╰╯┃┃┃┃━┫╭╯ ┃╰━╯┃┃╰╯┃┃┃┃╰┫┃┃┃╰╯┣╮╭┫┃━┫╰╮┃╰━╯┃┃┃╭╮┣╮╭╮╭┫╰┫┃━┫┃ ╰━━━┻┻━╮┣╯╰┻━┻╯╰┻━━╯╰╯╰━━┻━╯╰━━━┻╯╰╯╰╯╰╯╰╯╰━┻━━┻╯ ╱╱╱╱╱╭━╯┃ v2.27.4 ╱╱╱╱╱╰━━╯ 🔗 https://github.com/dipu-bd/lightnovel-crawler -------------------------------------------------------------------------------- 🔊 LOG LEVEL: DEBUG --------------------------------------------------------------------------------
➡ Press Ctrl + C to exit
2021-07-28 20:47:16,510 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): rebrand.ly:443
2021-07-28 20:47:16,533 [INFO] (lncrawl.utils.racovimge)
Jinja2 is required for cover generation:
pip install Jinja2
2021-07-28 20:47:16,535 [INFO] (lncrawl.core.downloader)
CairoSVG was not found.Install it to generate random cover image:
pip install cairosvg
2021-07-28 20:47:16,658 [INFO] (lncrawl.core.app)
Initialized App
2021-07-28 20:47:16,658 [INFO] (lncrawl.core.app)
Detected query input
2021-07-28 20:47:16,658 [INFO] (lncrawl.core.app)
Searching for novels in 100 sites...
2021-07-28 20:47:16,660 [INFO] (lncrawl.core.novel_search)
A crawler for "https://www.allnovel.org/" already exists
2021-07-28 20:47:16,778 [INFO] (lncrawl.core.novel_search)
A crawler for "https://booknet.com/" already exists
2021-07-28 20:47:16,820 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): arnovel.me:443
2021-07-28 20:47:16,846 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): 1stkissnovel.love:443
2021-07-28 20:47:16,861 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): allnovel.org:443
2021-07-28 20:47:16,878 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): asadatranslations.com:443
2021-07-28 20:47:16,917 [DEBUG] (lncrawl.core.crawler)
POST url=https://bestlightnovel.com/getsearchstory, data={'searchword': 'hero'}, headers={'content-type': 'application/x-www-form-urlencoded; charset=UTF-8'}
2021-07-28 20:47:16,926 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): booknet.com:443
2021-07-28 20:47:16,966 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): babelnovel.com:443
2021-07-28 20:47:17,000 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): boxnovel.com:443
2021-07-28 20:47:17,021 [DEBUG] (urllib3.connectionpool)
Starting new HTTP connection (1): boxnovel.cloud:80
2021-07-28 20:47:17,097 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): clicknovel.net:443
2021-07-28 20:47:17,107 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): boxnovel.online:443
2021-07-28 20:47:17,146 [DEBUG] (urllib3.connectionpool)
Starting new HTTP connection (1): boxnovel.org:80
2021-07-28 20:47:17,171 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): daonovel.com:443
2021-07-28 20:47:17,238 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): bestlightnovel.com:443
2021-07-28 20:47:17,250 [INFO] (lncrawl.core.novel_search)
A crawler for "https://docln.net/" already exists
2021-07-28 20:47:17,253 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): comrademao.com:443
2021-07-28 20:47:17,254 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.f-w-o.com:443
2021-07-28 20:47:17,298 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.fanfiction.net:443
2021-07-28 20:47:17,305 [DEBUG] (urllib3.connectionpool)
Starting new HTTP connection (1): hs2ppe.co.uk:80
2021-07-28 20:47:17,307 [DEBUG] (urllib3.connectionpool)
Starting new HTTP connection (1): fastnovel.net:80
2021-07-28 20:47:17,310 [DEBUG] (urllib3.connectionpool)
Starting new HTTP connection (1): www.hanyunovels.site:80
2021-07-28 20:47:17,313 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.foxaholic.com:443
2021-07-28 20:47:17,317 [INFO] (lncrawl.core.novel_search)
A crawler for "http://id.mtlnovel.com/" already exists
2021-07-28 20:47:17,324 [INFO] (lncrawl.core.novel_search)
A crawler for "http://fr.mtlnovel.com/" already exists
2021-07-28 20:47:17,325 [INFO] (lncrawl.core.novel_search)
A crawler for "http://es.mtlnovel.com/" already exists
2021-07-28 20:47:17,325 [INFO] (lncrawl.core.novel_search)
A crawler for "https://m.mywuxiaworld.com/" already exists
2021-07-28 20:47:17,325 [INFO] (lncrawl.core.novel_search)
A crawler for "https://novelfull.com/" already exists
2021-07-28 20:47:17,326 [INFO] (lncrawl.core.novel_search)
A crawler for "https://www.novels.pl/" already exists
2021-07-28 20:47:17,327 [INFO] (lncrawl.core.novel_search)
A crawler for "https://m.readlightnovel.cc/" already exists
2021-07-28 20:47:17,327 [INFO] (lncrawl.core.novel_search)
A crawler for "https://www.webnovel.com/" already exists
2021-07-28 20:47:17,328 [INFO] (lncrawl.core.novel_search)
A crawler for "https://wordexcerpt.org/" already exists
2021-07-28 20:47:17,328 [INFO] (lncrawl.core.novel_search)
A crawler for "https://m.wuxiaworld.co/" already exists
2021-07-28 20:47:17,329 [INFO] (lncrawl.core.novel_search)
A crawler for "https://wuxiaworld.name/" already exists
2021-07-28 20:47:17,465 [DEBUG] (urllib3.connectionpool)
https://www.fanfiction.net:443 "GET /search/?keywords=hero&type=story&match=title&ready=1&categoryid=202 HTTP/1.1" 200 None
2021-07-28 20:47:17,585 [DEBUG] (lncrawl.core.novel_search)
[{'title': "The Hero's Hero", 'url': 'https://www.fanfiction.net/s/2502372/1/The-Hero-s-Hero', 'info': 'Harry Potter | Chapters: 1 | By, Indoor Living'}, {'title': "Hero's Hero", 'url': 'https://www.fanfiction.net/s/11015402/1/Hero-s-Hero', 'info': 'Harry Potter | Chapters: 1 | By, aumnispark'}, {'title': "The Hero's Hero", 'url': 'https://www.fanfiction.net/s/13460624/1/The-Hero-s-Hero', 'info': 'Percy Jackson and the Olympians | Chapters: 1 | By, AmberMX'}, {'title': 'Hero', 'url': 'https://www.fanfiction.net/s/4283411/1/Hero', 'info': 'Chronicles of Narnia | Chapters: 1 | By, xxcloudedskysxx'}, {'title': 'Hero', 'url': 'https://www.fanfiction.net/s/6207823/1/Hero', 'info': 'Harry Potter | Chapters: 1 | By, Deh Malfoy'}, {'title': 'Hero', 'url': 'https://www.fanfiction.net/s/6155383/1/Hero', 'info': 'Harry Potter | Chapters: 6 | By, skippingthistown'}, {'title': 'Hero', 'url': 'https://www.fanfiction.net/s/6592222/1/Hero', 'info': 'Harry Potter | Chapters: 1 | By, That-Weasley-Girl'}, {'title': 'Heroes', 'url': 'https://www.fanfiction.net/s/4554558/1/Heroes', 'info': 'Maximum Ride | Chapters: 3 | By, iToke'}, {'title': 'To Be A Hero', 'url': 'https://www.fanfiction.net/s/4205133/1/To-Be-A-Hero', 'info': 'Bible | Chapters: 1 | By, koganei k'}, {'title': 'Hero', 'url': 'https://www.fanfiction.net/s/4175293/1/Hero', 'info': 'Clique | Chapters: 1 | By, The Damned Goddess'}, {'title': 'Hero', 'url': 'https://www.fanfiction.net/s/6103233/1/Hero', 'info': 'Twilight | Chapters: 10 | By, maggiexmae'}, {'title': 'Hero', 'url': 'https://www.fanfiction.net/s/6126818/1/Hero', 'info': 'Harry Potter | Chapters: 1 | By, Moony J4M'}, {'title': 'Hero', 'url': 'https://www.fanfiction.net/s/6496509/1/Hero', 'info': 'Bible | Chapters: 1 | By, Bar 96'}, {'title': 'There are no heroes', 'url': 'https://www.fanfiction.net/s/6480379/1/There-are-no-heroes', 'info': 'Harry Potter | Chapters: 1 | By, Midnight Eagle'}, {'title': 'Heroes', 'url': 'https://www.fanfiction.net/s/6020043/1/Heroes', 'info': 'Spy High | Chapters: 5 | By, kingcobley135'}, {'title': 'Hero', 'url': 'https://www.fanfiction.net/s/4132820/1/Hero', 'info': 'Pendragon | Chapters: 1 | By, formertape'}, {'title': 'Hero', 'url': 'https://www.fanfiction.net/s/4141397/1/Hero', 'info': 'Harry Potter | Chapters: 1 | By, Toby Mae Black'}, {'title': 'Hero', 'url': 'https://www.fanfiction.net/s/2887661/1/Hero', 'info': 'Harry Potter | Chapters: 1 | By, allycubed'}, {'title': 'Heroes', 'url': 'https://www.fanfiction.net/s/6632840/1/Heroes', 'info': 'Crossover - Harry Potter & Heroes | Chapters: 1 | By, Ninja Master'}, {'title': 'The Hero', 'url': 'https://www.fanfiction.net/s/4004059/1/The-Hero', 'info': 'Twilight | Chapters: 3 | By, The-Long-Lost-Cullen'}, {'title': 'A Hero', 'url': 'https://www.fanfiction.net/s/4428808/1/A-Hero', 'info': 'Maximum Ride | Chapters: 1 | By, ghj1'}, {'title': 'Hero', 'url': 'https://www.fanfiction.net/s/6337200/1/Hero', 'info': 'Harry Potter | Chapters: 1 | By, Dee Malfoy'}, {'title': 'Hero', 'url': 'https://www.fanfiction.net/s/6765439/1/Hero', 'info': 'Maximum Ride | Chapters: 1 | By, that lionhearted vagabond'}, {'title': 'Not a hero', 'url': 'https://www.fanfiction.net/s/6752556/1/Not-a-hero', 'info': "Harry Potter | Chapters: 1 | By, flyin'rabbit"}, {'title': 'Hero', 'url': 'https://www.fanfiction.net/s/3084734/1/Hero', 'info': 'Harry Potter | Chapters: 1 | By, TerreDuVent'}]
2021-07-28 20:47:17,585 [INFO] (lncrawl.core.novel_search)
25 results from https://www.fanfiction.net/
2021-07-28 20:47:17,588 [DEBUG] (urllib3.connectionpool)
https://rebrand.ly:443 "GET /lncrawl-pip HTTP/1.1" 301 0
2021-07-28 20:47:17,612 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): pypi.org:443
2021-07-28 20:47:17,614 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): kisslightnovels.info:443
2021-07-28 20:47:17,657 [DEBUG] (urllib3.connectionpool)
https://pypi.org:443 "GET /pypi/requests/json HTTP/1.1" 200 31882
2021-07-28 20:47:17,877 [DEBUG] (root)
Searching failure for http://www.hanyunovels.site/
2021-07-28 20:47:17,910 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): newsite.kolnovel.com:443
2021-07-28 20:47:18,013 [DEBUG] (urllib3.connectionpool)
https://babelnovel.com:443 "GET / HTTP/1.1" 200 None
2021-07-28 20:47:18,075 [DEBUG] (urllib3.connectionpool)
https://asadatranslations.com:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:18,102 [DEBUG] (urllib3.connectionpool)
https://allnovel.org:443 "GET /search?keyword=hero HTTP/1.1" 200 None
2021-07-28 20:47:18,162 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Hero Returns', 'url': 'https://allnovel.org/the-hero-returns.html', 'info': 'Chapter 383'}, {'title': 'Heroes of Marvel', 'url': 'https://allnovel.org/heroes-of-marvel.html', 'info': 'CHAPTER 667 VISI'}, {'title': 'I Was Kicked out of the Hero’s Party Because I Wasn’t a True Companion so I Decided to Have a Slow Life at the Frontier', 'url': 'https://allnovel.org/i-was-kicked-out-of-the-heros-party-because-i-wasnt-a-true-companion-so-i-decided-to-have-a-slow-life-at-the-frontier.html', 'info': 'Chapter 163 - Gideon’s answer'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://allnovel.org/shift-the-side-character-heroine.html', 'info': 'Chapter 773 (END) - The Eternal Heroine (Grand Finale)'}]
2021-07-28 20:47:18,162 [INFO] (lncrawl.core.novel_search)
4 results from https://allnovel.org/
2021-07-28 20:47:18,183 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): lightnovelbastion.com:443
2021-07-28 20:47:18,184 [DEBUG] (lncrawl.sources.babelnovel)
Visiting: https://api.babelnovel.com/v1/books?page=0&pageSize=8&fields=id,name,canonicalName,lastChapter&ignoreStatus=false&query=hero
2021-07-28 20:47:18,186 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): api.babelnovel.com:443
2021-07-28 20:47:18,190 [DEBUG] (urllib3.connectionpool)
https://boxnovel.online:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:18,226 [DEBUG] (urllib3.connectionpool)
https://bestlightnovel.com:443 "POST /getsearchstory HTTP/1.1" 200 None
2021-07-28 20:47:18,265 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Amber Sword', 'url': 'https://bestlightnovel.com/novel_888117175', 'info': 'Latest: Chapter 761 - v4c135 Breaking Cocoon (2)'}, {'title': 'Kill The Hero', 'url': 'https://bestlightnovel.com/novel_888141096', 'info': 'Latest: Chapter 275'}, {'title': 'Quick Transmigration: Heroine Arrives, Woman Rapidly Retreats!', 'url': 'https://bestlightnovel.com/novel_888102989', 'info': 'Latest: Chapter 333'}, {'title': 'Will The Re-Summoned Hero Live As An Ordinary Person', 'url': 'https://bestlightnovel.com/novel_888129918', 'info': 'Latest: Chapter 114'}, {'title': 'Ex-Hero Candidate’S, Who Turned Out To Be A Cheat From Lv2, Laid-Back Life In Another World', 'url': 'https://bestlightnovel.com/novel_888127277', 'info': 'Latest: Chapter 83'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://bestlightnovel.com/novel_888101963', 'info': 'Latest: Chapter 764 - A Laughing Stock?'}, {'title': 'Return Of The Former Hero', 'url': 'https://bestlightnovel.com/novel_888121215', 'info': 'Latest: Chapter 153'}, {'title': "I Was Kicked Out Of The Hero'S Party Because I Wasn'T A True Companion So I Decided To Have A Slow Life At The Frontier", 'url': 'https://bestlightnovel.com/novel_888115579', 'info': 'Latest: Chapter 163 - Gideon’s answer'}, {'title': 'The Hero Returns', 'url': 'https://bestlightnovel.com/novel_888165965', 'info': 'Latest: Chapter 383'}, {'title': 'Heroes Of Marvel', 'url': 'https://bestlightnovel.com/novel_888112833', 'info': 'Latest: CHAPTER 667 VISI'}, {'title': "My Status As An Assassin Obviously Exceeds The Hero'S", 'url': 'https://bestlightnovel.com/novel_888140853', 'info': 'Latest: Chapter 138'}, {'title': 'Asuka Of The Scarlet Sky', 'url': 'https://bestlightnovel.com/novel_888127554', 'info': 'Latest: Chapter 77'}, {'title': 'Suterareta Yuusha No Eiyuutan', 'url': 'https://bestlightnovel.com/novel_888109154', 'info': 'Latest: Volume 4 Chapter 15'}, {'title': 'Methods To Save The Villain Who Was Abandoned By The Heroine', 'url': 'https://bestlightnovel.com/novel_888141751', 'info': 'Latest: Chapter 13'}, {'title': 'Fff-Class Trashero', 'url': 'https://bestlightnovel.com/novel_888141047', 'info': 'Latest: Chapter 111'}, {'title': 'Heroic Wife Reborn', 'url': 'https://bestlightnovel.com/novel_888155565', 'info': "Latest: Chapter 138: The Young Women In The Monk''s Temple"}, {'title': 'Sendai Yuusha Wa Inkyou Shitai', 'url': 'https://bestlightnovel.com/novel_888129894', 'info': 'Latest: Chapter 164'}, {'title': 'Harassing Thief Girl', 'url': 'https://bestlightnovel.com/novel_888115719', 'info': 'Latest: Chapter 166'}, {'title': 'The Hero Proposed To Me', 'url': 'https://bestlightnovel.com/novel_888153585', 'info': 'Latest: Chapter 5'}, {'title': 'Shinwa Densetsu No Eiyuu No Isekaitan', 'url': 'https://bestlightnovel.com/novel_888129965', 'info': 'Latest: Vol 3 Chapter 6'}]
2021-07-28 20:47:18,267 [INFO] (lncrawl.core.novel_search)
20 results from https://bestlightnovel.com/
2021-07-28 20:47:18,289 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): lightnovelheaven.com:443
2021-07-28 20:47:18,341 [DEBUG] (urllib3.connectionpool)
http://boxnovel.cloud:80 "GET /search?keyword=hero HTTP/1.1" 200 None
2021-07-28 20:47:18,355 [DEBUG] (urllib3.connectionpool)
http://hs2ppe.co.uk:80 "GET /search?keyword=hero HTTP/1.1" 200 None
2021-07-28 20:47:18,367 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'A Player who eats Metal.', 'url': 'https://asadatranslations.com/novel/pwem/', 'info': 'Chapter 14: Exceptional Offer and Vacation - 2 | Rating: 5'}, {'title': 'The Former Witch Reincarnated as A Village Girl', 'url': 'https://asadatranslations.com/novel/fwrvg/', 'info': 'Chapter 7: Encounter with a Sage | Rating: 5'}, {'title': 'A VIP as Soon as You Log In', 'url': 'https://asadatranslations.com/novel/vip/', 'info': 'Chapter 28: Active Translations | Rating: 4.1'}, {'title': 'There is More to my Childhood Friend', 'url': 'https://asadatranslations.com/novel/tmcf/', 'info': 'Chapter 67: Rose’s Faith | Rating: 4.6'}, {'title': 'Reincarnated into a Werewolf, the Demon Lord Servants', 'url': 'https://asadatranslations.com/novel/der-werwolf/', 'info': 'Novel Status | Rating: 5'}, {'title': 'Reader', 'url': 'https://asadatranslations.com/novel/reader/', 'info': 'Notice | Rating: 4.1'}]
2021-07-28 20:47:18,370 [INFO] (lncrawl.core.novel_search)
6 results from https://asadatranslations.com/
2021-07-28 20:47:18,386 [DEBUG] (urllib3.connectionpool)
https://comrademao.com:443 "GET /?post_type=novel&s=hero HTTP/1.1" 200 None
2021-07-28 20:47:18,411 [DEBUG] (urllib3.connectionpool)
https://booknet.com:443 "GET /en/search?q=hero HTTP/1.1" 200 None
2021-07-28 20:47:18,414 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): light-novel.online:443
2021-07-28 20:47:18,419 [DEBUG] (urllib3.connectionpool)
http://boxnovel.org:80 "GET /search?keyword=hero HTTP/1.1" 301 178
2021-07-28 20:47:18,427 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): boxnovel.org:443
2021-07-28 20:47:18,524 [DEBUG] (urllib3.connectionpool)
https://api.babelnovel.com:443 "GET /v1/books?page=0&pageSize=8&fields=id,name,canonicalName,lastChapter&ignoreStatus=false&query=hero HTTP/1.1" 200 None
2021-07-28 20:47:18,527 [DEBUG] (urllib3.connectionpool)
https://daonovel.com:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:18,538 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Invincible Hero', 'url': 'https://api.babelnovel.com/v1/books/invincible-hero', 'info': None}, {'title': 'Great Hero', 'url': 'https://api.babelnovel.com/v1/books/great-hero', 'info': None}, {'title': 'Unlucky Hero Star', 'url': 'https://api.babelnovel.com/v1/books/unlucky-hero-star', 'info': None}, {'title': 'Talented Martial Hero', 'url': 'https://api.babelnovel.com/v1/books/talented-martial-hero', 'info': None}, {'title': 'The Peace Keeping Hero', 'url': 'https://api.babelnovel.com/v1/books/the-peace-keeping-hero', 'info': None}, {'title': 'Legend of A Hero', 'url': 'https://api.babelnovel.com/v1/books/legend-of-a-hero', 'info': None}, {'title': 'Martial Hero in Wasteland', 'url': 'https://api.babelnovel.com/v1/books/martial-hero-in-wasteland', 'info': None}, {'title': 'Hero Son-in-law', 'url': 'https://api.babelnovel.com/v1/books/hero-son-in-law', 'info': None}]
2021-07-28 20:47:18,546 [INFO] (lncrawl.core.novel_search)
8 results from https://babelnovel.com/
2021-07-28 20:47:18,580 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.lightnovelpub.com:443
2021-07-28 20:47:18,603 [DEBUG] (urllib3.connectionpool)
https://kisslightnovels.info:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:18,720 [DEBUG] (lncrawl.core.novel_search)
[]
2021-07-28 20:47:18,733 [INFO] (lncrawl.core.novel_search)
0 results from https://comrademao.com/
2021-07-28 20:47:18,738 [DEBUG] (lncrawl.core.novel_search)
[{'url': 'http://hs2ppe.co.uk/id-dqn-qnbx-bndebwc.html', 'title': 'The Hero Returns', 'info': 'Latest: Chapter 383'}, {'url': 'http://hs2ppe.co.uk/id-qnbxnc-xo-vabfnu.html', 'title': 'Heroes of Marvel', 'info': 'Latest: CHAPTER 667 VISI'}, {'url': 'http://hs2ppe.co.uk/id-wrmxvn-wx-ieecqa.html', 'title': 'Nidome no Yuusha', 'info': 'Latest: Chapter 202: A forcible end to the stalemate [Continuation]'}, {'url': 'http://hs2ppe.co.uk/id-vi-crcdnb-dqn-qnbxrwn-awm-r-dqn-fruuarwncc.html', 'title': 'My Sister the Heroine, and I the Villainess', 'info': 'Latest: Chapter 115'}, {'url': 'http://hs2ppe.co.uk/id-r-gac-trltnm-xed-xo-dqn-qnbxc-yabdi-knlaecn-r-gacwd-a-dben-lxvyawrxw-cx-r-mnlrmnm-dx-qafn-a-cuxg-uron-ad-dqn-obxwdrnb.html', 'title': "I Was Kicked out of the Hero's Party Because I Wasn't a True Companion so I Decided to Have a Slow Life at the Frontier", 'info': 'Latest: Chapter 163 - Gideon’s answer'}]
2021-07-28 20:47:18,755 [INFO] (lncrawl.core.novel_search)
5 results from http://hs2ppe.co.uk/
2021-07-28 20:47:18,771 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): lightnovelshub.com:443
2021-07-28 20:47:18,797 [DEBUG] (lncrawl.core.crawler)
POST url=https://lightnovelsonl.com/getsearchstory, data={'searchword': 'hero'}, headers={'content-type': 'application/x-www-form-urlencoded; charset=UTF-8'}
2021-07-28 20:47:18,806 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): lightnovelsonl.com:443
2021-07-28 20:47:19,072 [DEBUG] (urllib3.connectionpool)
https://arnovel.me:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:19,150 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Heroes Shed No Tears', 'url': 'http://boxnovel.cloud/novel/heroes-shed-no-tears', 'info': 'Latest chapter: Chapter 18: Heroes Never Die'}, {'title': 'The Laid-back Life in Another World of the Ex-Hero Candidate Who Turned out to be a Cheat from Level 2', 'url': 'http://boxnovel.cloud/novel/the-laid-back-life-in-another-world-of-the-ex-hero-candidate-who-turned-out-to-be-a-cheat-from-level-2', 'info': 'Latest chapter: Chapter 103'}, {'title': 'The Hero Returns', 'url': 'http://boxnovel.cloud/novel/the-hero-returns', 'info': 'Latest chapter: Chapter 383'}, {'title': 'Heroes of Marvel', 'url': 'http://boxnovel.cloud/novel/heroes-of-marvel', 'info': 'Latest chapter: CHAPTER 667 VISI'}, {'title': "I Was Kicked out of the Hero's Party Because I Wasn't a True Companion so I Decided to Have a Slow Life at the Frontier", 'url': 'http://boxnovel.cloud/novel/i-was-kicked-out-of-the-heros-party-because-i-wasnt-a-true-companion-so-i-decided-to-have-a-slow-life-at-the-frontier', 'info': 'Latest chapter: Chapter 163 - Gideon’s answer'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'http://boxnovel.cloud/novel/shift-the-side-character-heroine', 'info': 'Latest chapter: Chapter 773 (END) - The Eternal Heroine (Grand Finale)'}, {'title': "Hero? I've Long Stopped Being One", 'url': 'http://boxnovel.cloud/novel/hero-ive-long-stopped-being-one', 'info': 'Latest chapter: Chapter 3'}, {'title': 'My Hero', 'url': 'http://boxnovel.cloud/novel/my-hero', 'info': 'Latest chapter: short story (END)'}, {'title': 'Running Away From The Hero! (Remake)', 'url': 'http://boxnovel.cloud/novel/running-away-from-the-hero-remake', 'info': 'Latest chapter: Chapter 120'}, {'title': 'My Sister the Heroine, and I the Villainess', 'url': 'http://boxnovel.cloud/novel/my-sister-the-heroine-and-i-the-villainess', 'info': 'Latest chapter: Chapter 115'}]
2021-07-28 20:47:19,157 [INFO] (lncrawl.core.novel_search)
10 results from http://boxnovel.cloud/
2021-07-28 20:47:19,187 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /?s=hero&post_type=wp-manga HTTP/1.1" 200 None
2021-07-28 20:47:19,194 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): lightnovel.tv:443
2021-07-28 20:47:19,211 [DEBUG] (urllib3.connectionpool)
http://fastnovel.net:80 "GET /search/hero HTTP/1.1" 200 None
2021-07-28 20:47:19,254 [DEBUG] (urllib3.connectionpool)
https://newsite.kolnovel.com:443 "GET /?s=hero&post_type=wp-manga HTTP/1.1" 403 None
2021-07-28 20:47:19,262 [DEBUG] (root)
Searching failure for https://newsite.kolnovel.com/
2021-07-28 20:47:19,286 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): listnovel.com:443
2021-07-28 20:47:19,383 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Heroes', 'url': 'https://litnet.com/en/book/heroes-b219520', 'info': 'Author: Mira Diamond | 433 views | 8 favorites'}, {'title': 'Heroic Truth', 'url': 'https://litnet.com/en/book/heroic-truth-b145672', 'info': 'Author: Leev | 29966 views | 5 favorites'}, {'title': 'Small Town Hero (will be rewritten)', 'url': 'https://litnet.com/en/book/small-town-hero-will-be-rewritten-b116918', 'info': 'Author: VictorianEra | 23209 views | 155 favorites'}, {'title': 'True Hero: Champion Is Playing Book #1', 'url': 'https://litnet.com/en/book/true-hero-champion-is-playing-book-1-b122570', 'info': 'Author: Anton Emelianov and Sergei Savinov | 7276 views | 19 favorites'}, {'title': 'Code Hero: Champion Is Playing Book #2', 'url': 'https://litnet.com/en/book/code-hero-champion-is-playing-book-2-b123631', 'info': 'Author: Anton Emelianov and Sergei Savinov | 27283 views | 19 favorites'}, {'title': 'Earthbound: A Hero Chosen (book 1)', 'url': 'https://litnet.com/en/book/earthbound-a-hero-chosen-book-1-b144248', 'info': 'Author: Jake A. Strife | 78949 views | 9 favorites'}, {'title': 'Journal of a Hero (an experiment)', 'url': 'https://litnet.com/en/book/journal-of-a-hero-an-experiment-b144252', 'info': 'Author: Jake A. Strife | 2101 views | 2 favorites'}, {'title': 'The Champion is Playing: Hero Go!', 'url': 'https://litnet.com/en/book/the-champion-is-playing-hero-go-b149658', 'info': 'Author: Anton Emelianov and Sergei Savinov | 2349 views | 2 favorites'}, {'title': 'Chase Heo Dimensional Hero In: Powerless No More', 'url': 'https://litnet.com/en/book/chase-heo-dimensional-hero-in-powerless-no-more-b196445', 'info': 'Author: Chase Heo | 11 views | 5 favorites'}, {'title': 'chase heo dimensional hero in: the moon blade', 'url': 'https://litnet.com/en/book/chase-heo-dimensional-hero-in-the-moon-blade-b196805', 'info': 'Author: Chase Heo | 3 views | 4 favorites'}, {'title': 'Waves of a Hero', 'url': 'https://litnet.com/en/book/waves-of-a-hero-b270090', 'info': 'Author: M Saleh Dogara | 257 views | 8 favorites'}, {'title': 'A Hero In Between Dream Lines', 'url': 'https://litnet.com/en/book/a-hero-in-between-dream-lines-b340936', 'info': 'Author: Gammateddy | 5 views | 3 favorites'}, {'title': 'Alex Brim, Hero for Hire', 'url': 'https://litnet.com/en/book/alex-brim-hero-for-hire-b344019', 'info': 'Author: krushandkill | 76 views | 4 favorites'}, {'title': 'The Evolution: Rise of the Heroes', 'url': 'https://litnet.com/en/book/the-evolution-rise-of-the-heroes-b148465', 'info': 'Author: Paraknight | 10 views | 3 favorites'}, {'title': 'The Marked Heroes', 'url': 'https://litnet.com/en/book/the-marked-heroes-b207605', 'info': 'Author: Anthezar | 2042 views | 9 favorites'}, {'title': 'shamrock heros', 'url': 'https://litnet.com/en/book/shamrock-heros-b217197', 'info': 'Author: Shan | 151 views | 6 favorites'}, {'title': 'Zero Heroes', 'url': 'https://litnet.com/en/book/zero-heroes-b326612', 'info': 'Author: Elizabeth HC Louise | 4 views | 0 favorites'}]
2021-07-28 20:47:19,387 [INFO] (lncrawl.core.novel_search)
17 results from https://litnet.com/
2021-07-28 20:47:19,390 [DEBUG] (urllib3.connectionpool)
https://www.f-w-o.com:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:19,421 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): ln.hako.re:443
2021-07-28 20:47:19,485 [DEBUG] (urllib3.connectionpool)
https://lightnovelbastion.com:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:19,540 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Abandoned Hero is Going Home', 'url': 'https://kisslightnovels.info/novel/the-abandoned-hero-is-going-home/', 'info': 'The Abandoned Hero is Going Home Chapter 7 | Rating: 4'}, {'title': 'The Simple Job of Only Perishing to the Hero', 'url': 'https://kisslightnovels.info/novel/the-simple-job-of-only-perishing-to-the-hero/', 'info': 'The Simple Job of Only Perishing to the Hero Chapter 316 | Rating: 3.4'}, {'title': 'Gaikotsu Kishi-sama, Tadaima Isekai e Odekake-chuu', 'url': 'https://kisslightnovels.info/novel/gaikotsu-kishi-sama-tadaima-isekai-e-odekake-chuu/', 'info': 'Gaikotsu Kishi-sama, Tadaima Isekai e Odekake-chuu Chapter 191 | Rating: 3.7'}, {'title': 'To Be a Power in the Shadows!', 'url': 'https://kisslightnovels.info/novel/to-be-a-power-in-the-shadows/', 'info': 'To Be a Power in the Shadows Chapter 203 | Rating: 5'}, {'title': 'Apocalypse Cockroach', 'url': 'https://kisslightnovels.info/novel/apocalypse-cockroach/', 'info': 'Apocalypse Cockroach Chapter 261 | Rating: 5'}, {'title': 'God and Devil World', 'url': 'https://kisslightnovels.info/novel/god-and-devil-world/', 'info': 'God and Devil World Chapter 1217 | Rating: 3.3'}, {'title': 'Immortal and Martial Dual Cultivation', 'url': 'https://kisslightnovels.info/novel/immortal-and-martial-dual-cultivation/', 'info': 'Immortal and Martial Dual Cultivation Chapter1638 | Rating: 4.3'}, {'title': 'Castle of Black Iron', 'url': 'https://kisslightnovels.info/novel/castle-of-black-iron/', 'info': 'Castle of Black Iron Chapter 2015 | Rating: 3.7'}, {'title': 'Albert Ke no Reijou wa Botsuraku wo go Shomou desu', 'url': 'https://kisslightnovels.info/novel/albert-ke-no-reijou-wa-botsuraku-wo-go-shomou-desu/', 'info': 'Albert Ke no Reijou wa Botsuraku wo go Shomou desu Chapter 45 | Rating: 4.5'}, {'title': 'The Sage Who Transcended Samsara', 'url': 'https://kisslightnovels.info/novel/the-sage-who-transcended-samsara/', 'info': 'The Sage Who Transcended Samsara Chapter 835 | Rating: 4.3'}, {'title': 'Trash of the Count’s Family', 'url': 'https://kisslightnovels.info/novel/trash-of-the-counts-family-web-novel-free/', 'info': 'Trash of the Count’s Family Chapter 353 | Rating: 4.1'}, {'title': 'Stop, Friendly Fire!', 'url': 'https://kisslightnovels.info/novel/stop-friendly-fire/', 'info': 'Stop Friendly Fire Chapter 266 | Rating: 4.7'}, {'title': 'Yuusha Ga Onna Da to Dame Desu Ka', 'url': 'https://kisslightnovels.info/novel/yuusha-ga-onna-da-to-dame-desu-ka/', 'info': 'Yuusha Ga Onna Da to Dame Desu Ka Chapter 42 | Rating: 4.3'}]
2021-07-28 20:47:19,545 [INFO] (lncrawl.core.novel_search)
13 results from https://kisslightnovels.info/
2021-07-28 20:47:19,569 [DEBUG] (lncrawl.sources.machinetransorg)
Visiting: https://www.machine-translation.org/novel/search/?keywords=hero
2021-07-28 20:47:19,578 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.machine-translation.org:443
2021-07-28 20:47:19,623 [DEBUG] (urllib3.connectionpool)
https://light-novel.online:443 "GET /search.ajax?query=hero HTTP/1.1" 301 None
2021-07-28 20:47:19,630 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): wuxiaworldsite.co:443
2021-07-28 20:47:19,825 [DEBUG] (lncrawl.core.novel_search)
[]
2021-07-28 20:47:19,829 [INFO] (lncrawl.core.novel_search)
0 results from https://www.f-w-o.com/
2021-07-28 20:47:19,856 [DEBUG] (urllib3.connectionpool)
https://lightnovelsonl.com:443 "POST /getsearchstory HTTP/1.1" 200 None
2021-07-28 20:47:19,857 [DEBUG] (root)
Searching failure for https://light-novel.online/
2021-07-28 20:47:19,883 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): morenovel.net:443
2021-07-28 20:47:19,903 [DEBUG] (urllib3.connectionpool)
Starting new HTTP connection (1): www.mtlnovel.com:80
2021-07-28 20:47:19,932 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Amber Sword', 'url': 'https://lightnovelsonl.com/novel/the_amber_sword', 'info': 'Latest: Chapter 761 - v4c135 Breaking Cocoon (2)'}, {'title': 'Kill The Hero', 'url': 'https://lightnovelsonl.com/novel/kill_the_hero', 'info': 'Latest: Chapter 275'}, {'title': 'Quick Transmigration: Heroine Arrives, Woman Rapidly Retreats!', 'url': 'https://lightnovelsonl.com/novel/quick_transmigration_heroine_arrives_woman_rapidly_retreats', 'info': 'Latest: Chapter 333'}, {'title': 'Will The Re-Summoned Hero Live As An Ordinary Person', 'url': 'https://lightnovelsonl.com/novel/will_the_resummoned_hero_live_as_an_ordinary_person', 'info': 'Latest: Chapter 114'}, {'title': 'Ex-Hero Candidate’S, Who Turned Out To Be A Cheat From Lv2, Laid-Back Life In Another World', 'url': 'https://lightnovelsonl.com/novel/exhero_candidates_who_turned_out_to_be_a_cheat_from_lv2_laidback_life_in_another_world', 'info': 'Latest: Chapter 83'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://lightnovelsonl.com/novel/shift_the_sidecharacter_heroine', 'info': 'Latest: Chapter 764 - A Laughing Stock?'}, {'title': 'Return Of The Former Hero', 'url': 'https://lightnovelsonl.com/novel/return_of_the_former_hero', 'info': 'Latest: Chapter 153'}, {'title': "I Was Kicked Out Of The Hero'S Party Because I Wasn'T A True Companion So I Decided To Have A Slow Life At The Frontier", 'url': 'https://lightnovelsonl.com/novel/i_was_kicked_out_of_the_heros_party_because_i_wasnt_a_true_companion_so_i_decided_to_have_a_slow_life_at_the_frontier', 'info': 'Latest: Chapter 163 - Gideon’s answer'}, {'title': 'The Hero Returns', 'url': 'https://lightnovelsonl.com/novel/the_hero_returns', 'info': 'Latest: Chapter 383'}, {'title': 'Heroes Of Marvel', 'url': 'https://lightnovelsonl.com/novel/heroes_of_marvel', 'info': 'Latest: CHAPTER 667 VISI'}, {'title': "My Status As An Assassin Obviously Exceeds The Hero'S", 'url': 'https://lightnovelsonl.com/novel/my_status_as_an_assassin_obviously_exceeds_the_heros', 'info': 'Latest: Chapter 138'}, {'title': 'Asuka Of The Scarlet Sky', 'url': 'https://lightnovelsonl.com/novel/asuka_of_the_scarlet_sky', 'info': 'Latest: Chapter 77'}, {'title': 'Suterareta Yuusha No Eiyuutan', 'url': 'https://lightnovelsonl.com/novel/suterareta_yuusha_no_eiyuutan', 'info': 'Latest: Volume 4 Chapter 15'}, {'title': 'Methods To Save The Villain Who Was Abandoned By The Heroine', 'url': 'https://lightnovelsonl.com/novel/zkp8054792241555402699', 'info': 'Latest: Chapter 13'}, {'title': 'Fff-Class Trashero', 'url': 'https://lightnovelsonl.com/novel/fffclass_trashero', 'info': 'Latest: Chapter 111'}, {'title': 'Heroic Wife Reborn', 'url': 'https://lightnovelsonl.com/novel/cxy1819458541570675324', 'info': "Latest: Chapter 138: The Young Women In The Monk''s Temple"}, {'title': 'Sendai Yuusha Wa Inkyou Shitai', 'url': 'https://lightnovelsonl.com/novel/sendai_yuusha_wa_inkyou_shitai', 'info': 'Latest: Chapter 164'}, {'title': 'Harassing Thief Girl', 'url': 'https://lightnovelsonl.com/novel/harassing_thief_girl', 'info': 'Latest: Chapter 166'}, {'title': 'The Hero Proposed To Me', 'url': 'https://lightnovelsonl.com/novel/kth4800505051564797286', 'info': 'Latest: Chapter 5'}, {'title': 'Shinwa Densetsu No Eiyuu No Isekaitan', 'url': 'https://lightnovelsonl.com/novel/shinwa_densetsu_no_eiyuu_no_isekaitan', 'info': 'Latest: Vol 3 Chapter 6'}]
2021-07-28 20:47:19,943 [INFO] (lncrawl.core.novel_search)
20 results from https://lightnovelsonl.com/
2021-07-28 20:47:19,990 [DEBUG] (urllib3.connectionpool)
http://www.mtlnovel.com:80 "GET //wp-admin/admin-ajax.php?action=autosuggest&q=hero HTTP/1.1" 301 None
2021-07-28 20:47:19,992 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): mysticalmerries.com:443
2021-07-28 20:47:20,012 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.mtlnovel.com:443
2021-07-28 20:47:20,047 [DEBUG] (urllib3.connectionpool)
https://boxnovel.org:443 "GET /search?keyword=hero HTTP/1.1" 200 None
2021-07-28 20:47:20,055 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Hero Proposed to Me', 'url': 'https://daonovel.com/novel/the-hero-proposed-to-me/', 'info': 'Chapter 16.2 | Rating: 4.7'}, {'title': 'Not All Heroes From Earth Are Bad', 'url': 'https://daonovel.com/novel/not-all-heroes-from-earth-are-bad/', 'info': 'Chapter 35 | Rating: 4.6'}, {'title': 'Deity Hero: Me! Gaining Disciples Makes Me Stronger!', 'url': 'https://daonovel.com/novel/deity-hero-me-gaining-disciples-makes-me-stronger/', 'info': 'Chapter 190 | Rating: 3.8'}, {'title': 'After Becoming the Hero’s Ex-fiancée', 'url': 'https://daonovel.com/novel/after-becoming-the-heros-ex-fiancee/', 'info': 'Chapter 26 | Rating: 4.3'}, {'title': 'Immortal Hero: I Can See the Success Rate', 'url': 'https://daonovel.com/novel/immortal-hero-i-can-see-the-success-rate/', 'info': 'Chapter 121 | Rating: 3.9'}, {'title': 'Immortal Hero: I Can Replicate Talents', 'url': 'https://daonovel.com/novel/immortal-hero-i-can-replicate-talents/', 'info': 'Chapter 43 | Rating: 4.3'}, {'title': 'The Heroine has Her Eyes on Me as Her Brother’s Wife', 'url': 'https://daonovel.com/novel/the-female-lead-turn-me-into-her-new-sister/', 'info': 'Chapter 13 | Rating: 4.5'}, {'title': 'I Have Become The Hero’s Rival', 'url': 'https://daonovel.com/novel/i-have-become-the-heros-rival/', 'info': 'Chapter 23 | Rating: 4.6'}, {'title': 'Even Though I’m the Villainess, I’ll Become the Heroine!', 'url': 'https://daonovel.com/novel/even-though-im-the-villainess-ill-become-the-heroine/', 'info': 'Chapter 5 | Rating: 4.4'}, {'title': 'My Lady, Please Become My Heroine!', 'url': 'https://daonovel.com/novel/my-lady-please-become-my-heroine/', 'info': 'Chapter 13 | Rating: 4.9'}, {'title': 'Please Love Me From Now On!', 'url': 'https://daonovel.com/novel/please-love-me-from-now-on/', 'info': 'Chapter 6 | Rating: 5'}, {'title': 'After Signing In For a Hundred Years, I Have Become the Big Brother of Vampires', 'url': 'https://daonovel.com/novel/after-signing-in-for-a-hundred-years-i-have-become-the-big-brother-of-vampires/', 'info': 'Chapter 40 | Rating: 4.5'}, {'title': 'My Dungeons Are Popular', 'url': 'https://daonovel.com/novel/my-dungeons-are-popular/', 'info': 'Chapter 91 | Rating: 4.6'}, {'title': 'My Fusion System: Fusing a Thousand Chickens at the Start', 'url': 'https://daonovel.com/novel/my-fusion-system-fusing-a-thousand-chickens-at-the-start/', 'info': 'Chapter 200 | Rating: 3.9'}, {'title': 'Pet Beasts of the World: Hundred-Fold Multiplier System', 'url': 'https://daonovel.com/novel/pet-beasts-of-the-world-hundred-fold-multiplier-system/', 'info': 'Chapter 181 | Rating: 4'}, {'title': 'I Experienced an SSS Encryption', 'url': 'https://daonovel.com/novel/i-experienced-an-sss-encryption/', 'info': 'Chapter 130 | Rating: 4'}, {'title': 'The Discarded Hero wants to Return Home', 'url': 'https://daonovel.com/novel/the-discarded-hero-wants-to-return-home/', 'info': 'Chapter 6 | Rating: 4.9'}, {'title': 'Heroes of Marvel', 'url': 'https://daonovel.com/novel/heroes-of-marvel/', 'info': 'Chapter 115 | Rating: 4.3'}]
2021-07-28 20:47:20,065 [INFO] (lncrawl.core.novel_search)
18 results from https://daonovel.com/
2021-07-28 20:47:20,091 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.mywuxiaworld.com:443
2021-07-28 20:47:20,097 [DEBUG] (urllib3.connectionpool)
https://www.lightnovelpub.com:443 "GET /search?title=hero HTTP/1.1" 200 None
2021-07-28 20:47:20,134 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Ero Skill Tree', 'url': 'http://fastnovel.net/ero-skill-tree-9992/', 'info': 'Chapter 119'}, {'title': 'Age Of Heroes ( Age Of Heroes Chronicles)', 'url': 'http://fastnovel.net/age-of-heroes-age-of-heroes-chronicles2-1561/', 'info': 'Chapter 591'}, {'title': 'Chronicles Of The Shura Clan', 'url': 'http://fastnovel.net/chronicles-of-the-shura-clan4-4735/', 'info': 'Chapter 375'}, {'title': 'Guild Wars', 'url': 'http://fastnovel.net/guild-wars8-1046/', 'info': 'Chapter 544'}, {'title': 'Everything Will Be My Way!', 'url': 'http://fastnovel.net/everything-will-be-my-way5-1003/', 'info': 'Chapter 402'}, {'title': 'Godfather And Godson', 'url': 'http://fastnovel.net/godfather-and-godson-10075/', 'info': 'Chapter 165'}, {'title': 'Marvel: A Symbiotic Life', 'url': 'http://fastnovel.net/marvel-a-symbiotic-life-9990/', 'info': 'Chapter 176'}, {'title': 'The Spider Queen', 'url': 'http://fastnovel.net/the-spider-queen6-9798/', 'info': 'Chapter 325'}, {'title': 'Dragons Among Heroes', 'url': 'http://fastnovel.net/dragons-among-heroes-1426/', 'info': 'Chapter 69'}, {'title': 'Wish Fulfillment System', 'url': 'http://fastnovel.net/wish-fulfillment-system-1958/', 'info': 'Chapter 139'}, {'title': 'L.u.s.t Knight', 'url': 'http://fastnovel.net/lust-knight5-9684/', 'info': 'Chapter 339'}, {'title': "Reincarnation: Villainess' Chosen Path", 'url': 'http://fastnovel.net/reincarnation-villainess-chosen-path-1929/', 'info': 'Chapter 32'}, {'title': 'Wake Up As Mafia Boss', 'url': 'http://fastnovel.net/wake-up-as-mafia-boss-1253/', 'info': 'Chapter 53'}, {'title': 'She Becomes The Hero In Another World', 'url': 'http://fastnovel.net/she-becomes-the-hero-in-another-world-1134/', 'info': 'Chapter 222'}, {'title': 'The Insurrection Of The Inept Hero', 'url': 'http://fastnovel.net/the-insurrection-of-the-inept-hero1-10031/', 'info': 'Chapter 113'}, {'title': 'The Bastard In The Zombie Apocalypse', 'url': 'http://fastnovel.net/the-bastard-in-the-zombie-apocalypse-1392/', 'info': 'Chapter 218'}, {'title': 'Avenger From Another World', 'url': 'http://fastnovel.net/avenger-from-another-world-5925/', 'info': 'Chapter 83'}, {'title': 'My Hero Academia: Reborn As Denki Kaminari', 'url': 'http://fastnovel.net/my-hero-academia-reborn-as-denki-kaminari-10000/', 'info': 'Chapter 111'}, {'title': 'Gravity Control, In MHA', 'url': 'http://fastnovel.net/gravity-control-in-mha-9983/', 'info': 'Chapter 43'}, {'title': 'Marvels Op Hero', 'url': 'http://fastnovel.net/marvels-op-hero-9997/', 'info': 'Chapter 71'}, {'title': 'THE BLACKLIGHT', 'url': 'http://fastnovel.net/the-blacklight-1443/', 'info': 'Chapter 179'}, {'title': 'Sinfull Life With The Strongest System', 'url': 'http://fastnovel.net/sinfull-life-with-the-strongest-system7-1512/', 'info': 'Chapter 279'}, {'title': 'The CEO Who Hates Me', 'url': 'http://fastnovel.net/the-ceo-who-hates-me5-165/', 'info': 'Chapter 255'}, {'title': 'The Ultimate Transmigration', 'url': 'http://fastnovel.net/the-ultimate-transmigration-9765/', 'info': 'Chapter 82'}, {'title': 'Hero Or Villaness', 'url': 'http://fastnovel.net/hero-or-villaness-6173/', 'info': 'Chapter 34'}, {'title': 'Empire Of Heroes: Fate X DanMachi', 'url': 'http://fastnovel.net/empire-of-heroes-fate-x-danmachi-9872/', 'info': 'Chapter 29'}, {'title': "My Hero Academia: A Hero's Will", 'url': 'http://fastnovel.net/my-hero-academia-a-heros-will-1494/', 'info': 'Chapter 44'}, {'title': 'Reincarnated With A Undead System?', 'url': 'http://fastnovel.net/reincarnated-with-a-undead-system-8210/', 'info': 'Chapter 10'}, {'title': 'Brutal Journey Of An Unfortunate Heroine', 'url': 'http://fastnovel.net/brutal-journey-of-an-unfortunate-heroine-1609/', 'info': 'Chapter 80'}, {'title': 'Holy Akashic Conqueror', 'url': 'http://fastnovel.net/holy-akashic-conqueror-486/', 'info': 'Chapter 205'}, {'title': 'Naruto: Birth Of A New Sage', 'url': 'http://fastnovel.net/naruto-birth-of-a-new-sage-707/', 'info': 'Chapter 43'}, {'title': 'Dragonball X: The Ultimate System (Different Path)', 'url': 'http://fastnovel.net/dragonball-x-the-ultimate-system-different-path-9679/', 'info': 'Chapter 88'}]
2021-07-28 20:47:20,141 [INFO] (lncrawl.core.novel_search)
32 results from http://fastnovel.net/
2021-07-28 20:47:20,176 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): novel27.com:443
2021-07-28 20:47:20,368 [DEBUG] (urllib3.connectionpool)
https://ln.hako.re:443 "GET /tim-kiem-nang-cao?title=hero HTTP/1.1" 200 None
2021-07-28 20:47:20,397 [DEBUG] (urllib3.connectionpool)
https://lightnovelshub.com:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:20,408 [DEBUG] (urllib3.connectionpool)
https://www.machine-translation.org:443 "GET /novel/search/?keywords=hero HTTP/1.1" 200 None
2021-07-28 20:47:20,472 [DEBUG] (urllib3.connectionpool)
https://lightnovelheaven.com:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:20,536 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'My Hero Academia: Reborn as Denki Kaminari', 'url': 'https://arnovel.me/novel/%d8%a3%d9%83%d8%a7%d8%af%d9%8a%d9%85%d9%8a%d8%a9-%d8%a8%d8%b7%d9%84%d9%8a-%d9%88%d9%84%d8%af%d8%aa-%d9%85%d9%86-%d8%ac%d8%af%d9%8a%d8%af-%d9%83%d9%80-%d8%af%d9%8a%d9%86%d9%83%d9%8a-%d9%83%d8%a7%d9%85/', 'info': '110 - النهاية | Rating: 0'}, {'title': 'Kill the Hero', 'url': 'https://arnovel.me/novel/kill-the-hero/', 'info': '2 | Rating: 0'}, {'title': 'Hero System! Transported to Another World', 'url': 'https://arnovel.me/novel/%d9%86%d8%b8%d8%a7%d9%85-%d8%a7%d9%84%d8%a8%d8%b7%d9%84-%d8%a7%d9%86%d8%aa%d9%82%d9%84-%d8%a5%d9%84%d9%89-%d8%b9%d8%a7%d9%84%d9%85-%d8%a2%d8%ae%d8%b1/', 'info': '43 - شرح؟ | Rating: 0'}, {'title': 'I’m Spying on the Heroine in an Otome Game World', 'url': 'https://arnovel.me/novel/%d8%a3%d9%86%d8%a7-%d8%a3%d8%aa%d8%ac%d8%b3%d8%b3-%d8%b9%d9%84%d9%89-%d8%a7%d9%84%d8%a8%d8%b7%d9%84%d8%a9-%d9%81%d9%8a-%d8%b9%d8%a7%d9%84%d9%85-%d9%84%d8%b9%d8%a8%d8%a9-%d8%a7%d9%88%d8%aa%d9%88%d9%85/', 'info': '38 | Rating: 0'}]
2021-07-28 20:47:20,542 [INFO] (lncrawl.core.novel_search)
4 results from https://arnovel.me/
2021-07-28 20:47:20,569 [DEBUG] (urllib3.connectionpool)
https://www.mtlnovel.com:443 "GET //wp-admin/admin-ajax.php?action=autosuggest&q=hero HTTP/1.1" 200 None
2021-07-28 20:47:20,583 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.novelall.com:443
2021-07-28 20:47:20,597 [DEBUG] (urllib3.connectionpool)
Starting new HTTP connection (1): id.mtlnovel.com:80
2021-07-28 20:47:20,654 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Reincarnation Of The Strongest Sword God (Web Novel)', 'url': 'https://www.lightnovelpub.com/novel/reincarnation-of-the-strongest-sword-god-lnv-27072150', 'info': 'Rank 2'}, {'title': 'The Beginning After The End (Web Novel)', 'url': 'https://www.lightnovelpub.com/novel/the-beginning-after-the-end-novel-27072145', 'info': 'Rank 1'}, {'title': 'My Vampire System (WN)', 'url': 'https://www.lightnovelpub.com/novel/my-vampire-system-novel-19072354', 'info': 'Rank 4'}, {'title': 'Super Gene (Web Novel)', 'url': 'https://www.lightnovelpub.com/novel/super-god-gene-novel-27072152', 'info': 'Rank 6'}, {'title': "Trash of the Count's Family (Web Novel)", 'url': 'https://www.lightnovelpub.com/novel/trash-count-wn-27072152', 'info': 'Rank 3'}, {'title': 'The Legendary Mechanic (WN)', 'url': 'https://www.lightnovelpub.com/novel/the-legendary-mechanic-novel-27072152', 'info': 'Rank 5'}, {'title': 'Supreme Magus (Web Novel)', 'url': 'https://www.lightnovelpub.com/novel/supreme-magus-webnovel-27072152', 'info': 'Rank 8'}, {'title': 'Cultivation Online', 'url': 'https://www.lightnovelpub.com/novel/cultivation-online-19072354', 'info': 'Rank 7'}, {'title': 'Perfect Secret Love: The Bad New Wife is a Little Sweet', 'url': 'https://www.lightnovelpub.com/novel/perfect-secret-love-the-bad-new-wife-is-a-little-sweet-19072354', 'info': 'Rank 9'}, {'title': 'Supremacy Games', 'url': 'https://www.lightnovelpub.com/novel/supremacy-games-27072152', 'info': 'Rank 10'}]
2021-07-28 20:47:20,656 [INFO] (lncrawl.core.novel_search)
10 results from https://www.lightnovelpub.com/
2021-07-28 20:47:20,683 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): novelcake.com:443
2021-07-28 20:47:20,685 [DEBUG] (urllib3.connectionpool)
http://id.mtlnovel.com:80 "GET //wp-admin/admin-ajax.php?action=autosuggest&q=hero HTTP/1.1" 301 None
2021-07-28 20:47:20,691 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): id.mtlnovel.com:443
2021-07-28 20:47:20,768 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Death Mage', 'url': 'https://lightnovelbastion.com/novel/death-mage/', 'info': 'Death Mage 256 | Rating: 4.9'}]
2021-07-28 20:47:20,783 [INFO] (lncrawl.core.novel_search)
1 results from https://lightnovelbastion.com/
2021-07-28 20:47:20,824 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): novelextra.com:443
2021-07-28 20:47:21,130 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'My Status as an Assassin Obviously Exceeds the Hero’s', 'url': 'https://boxnovel.online/novel/my-status-as-an-assassin-obviously-exceeds-the-heros/', 'info': 'prologue'}, {'title': 'The Laid-back Life in Another World of the Ex-Hero Candidate Who Turned out to be a Cheat from Level 2', 'url': 'https://boxnovel.online/novel/the-laid-back-life-in-another-world-of-the-ex-hero-candidate-who-turned-out-to-be-a-cheat-from-level-2/', 'info': 'illustrations'}, {'title': 'Will the Re-Summoned Hero Live as an Ordinary Person', 'url': 'https://boxnovel.online/novel/will-the-re-summoned-hero-live-as-an-ordinary-person/', 'info': 'Chapter 121'}, {'title': 'The Simple Job of Only Perishing to the Hero', 'url': 'https://boxnovel.online/novel/the-simple-job-of-only-perishing-to-the-hero/', 'info': 'prologue'}, {'title': 'The Coming Heroine: The Only Princess', 'url': 'https://boxnovel.online/novel/the-coming-heroine-the-only-princess/', 'info': 'Chapter 182'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://boxnovel.online/novel/shift-the-side-character-heroine/', 'info': 'Chapter 764 - A Laughing Stock?'}, {'title': 'Ankoku Kishi Monogatari ~Yuusha wo Taosu Tameni Maou ni Shoukansaremashita~', 'url': 'https://boxnovel.online/novel/ankoku-kishi-monogatari-yuusha-wo-taosu-tameni-maou-ni-shoukansaremashita/', 'info': 'Chapter 53'}, {'title': 'Nanomancer Reborn – I’ve Become A Snow Girl?', 'url': 'https://boxnovel.online/novel/nanomancer-reborn-ive-become-a-snow-girl/', 'info': 'Chapter 418'}, {'title': 'Naruto is Reincarnated', 'url': 'https://boxnovel.online/novel/naruto-is-reincarnated/', 'info': 'Chapter 198'}, {'title': 'The Dungeon Seeker', 'url': 'https://boxnovel.online/novel/the-dungeon-seeker/', 'info': 'Prologue'}, {'title': 'Asuka of the Scarlet Sky', 'url': 'https://boxnovel.online/novel/asuka-of-the-scarlet-sky/', 'info': 'Chapter 77'}, {'title': 'Isekai Mahou wa Okureteru! (LN)', 'url': 'https://boxnovel.online/novel/isekai-mahou-wa-okureteru-ln/', 'info': 'prologue'}, {'title': 'After Transformation, Mine and Her Wild Fantasy', 'url': 'https://boxnovel.online/novel/after-transformation-mine-and-her-wild-fantasy/', 'info': 'Chapter 164'}, {'title': 'The Transmigration Survival Guide', 'url': 'https://boxnovel.online/novel/the-transmigration-survival-guide/', 'info': 'prologue'}, {'title': 'Once Upon A Time, There Was A Spirit Sword Mountain', 'url': 'https://boxnovel.online/novel/once-upon-a-time-there-was-a-spirit-sword-mountain/', 'info': 'Prologue'}, {'title': 'Tondemo Skill de Isekai Hourou Meshi', 'url': 'https://boxnovel.online/novel/tondemo-skill-de-isekai-hourou-meshi/', 'info': 'Chapter 173'}, {'title': 'Summoned Slaughterer', 'url': 'https://boxnovel.online/novel/summoned-slaughterer/', 'info': 'Chapter 179'}, {'title': 'The Devil’s Evolution Catalog', 'url': 'https://boxnovel.online/novel/the-devils-evolution-catalog/', 'info': 'Chapter 331'}, {'title': 'MMORPG: The Elementalist', 'url': 'https://boxnovel.online/novel/mmorpg-the-elementalist/', 'info': 'Chapter 709 - A New Conquest'}, {'title': 'The Empress’s Gigolo', 'url': 'https://boxnovel.online/novel/the-empresss-gigolo-2/', 'info': 'Chapter 821'}, {'title': 'Nidome no Yuusha', 'url': 'https://boxnovel.online/novel/nidome-no-yuusha/', 'info': 'illustrations'}]
2021-07-28 20:47:21,133 [INFO] (lncrawl.core.novel_search)
21 results from https://boxnovel.online/
2021-07-28 20:47:21,164 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): novelfull.com:443
2021-07-28 20:47:21,276 [DEBUG] (urllib3.connectionpool)
https://mysticalmerries.com:443 "GET /?s=hero HTTP/1.1" 200 None
2021-07-28 20:47:21,314 [DEBUG] (urllib3.connectionpool)
https://id.mtlnovel.com:443 "GET //wp-admin/admin-ajax.php?action=autosuggest&q=hero HTTP/1.1" 200 None
2021-07-28 20:47:21,331 [DEBUG] (urllib3.connectionpool)
Starting new HTTP connection (1): fr.mtlnovel.com:80
2021-07-28 20:47:21,398 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Heroes Shed No Tears', 'url': 'https://boxnovel.org/novel/heroes-shed-no-tears', 'info': 'Latest chapter: Chapter 18: Heroes Never Die'}, {'title': 'The Laid-back Life in Another World of the Ex-Hero Candidate Who Turned out to be a Cheat from Level 2', 'url': 'https://boxnovel.org/novel/the-laid-back-life-in-another-world-of-the-ex-hero-candidate-who-turned-out-to-be-a-cheat-from-level-2', 'info': 'Latest chapter: Chapter 103'}, {'title': 'The Hero Returns', 'url': 'https://boxnovel.org/novel/the-hero-returns', 'info': 'Latest chapter: Chapter 383'}, {'title': 'Heroes of Marvel', 'url': 'https://boxnovel.org/novel/heroes-of-marvel', 'info': 'Latest chapter: CHAPTER 667 VISI'}, {'title': "I Was Kicked out of the Hero's Party Because I Wasn't a True Companion so I Decided to Have a Slow Life at the Frontier", 'url': 'https://boxnovel.org/novel/i-was-kicked-out-of-the-heros-party-because-i-wasnt-a-true-companion-so-i-decided-to-have-a-slow-life-at-the-frontier', 'info': 'Latest chapter: Chapter 163 - Gideon’s answer'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://boxnovel.org/novel/shift-the-side-character-heroine', 'info': 'Latest chapter: Chapter 773 (END) - The Eternal Heroine (Grand Finale)'}, {'title': "Hero? I've Long Stopped Being One", 'url': 'https://boxnovel.org/novel/hero-ive-long-stopped-being-one', 'info': 'Latest chapter: Chapter 3'}, {'title': 'My Hero', 'url': 'https://boxnovel.org/novel/my-hero', 'info': 'Latest chapter: short story (END)'}, {'title': 'Running Away From The Hero! (Remake)', 'url': 'https://boxnovel.org/novel/running-away-from-the-hero-remake', 'info': 'Latest chapter: Chapter 120'}, {'title': 'My Sister the Heroine, and I the Villainess', 'url': 'https://boxnovel.org/novel/my-sister-the-heroine-and-i-the-villainess', 'info': 'Latest chapter: Chapter 115'}]
2021-07-28 20:47:21,400 [INFO] (lncrawl.core.novel_search)
10 results from http://boxnovel.org/
2021-07-28 20:47:21,438 [DEBUG] (urllib3.connectionpool)
http://fr.mtlnovel.com:80 "GET //wp-admin/admin-ajax.php?action=autosuggest&q=hero HTTP/1.1" 301 None
2021-07-28 20:47:21,464 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): novelfullplus.com:443
2021-07-28 20:47:21,476 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): fr.mtlnovel.com:443
2021-07-28 20:47:21,558 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Heroic Death System', 'url': 'https://www.machine-translation.org/novel/b78efb711990162d/heroic-death-system.html', 'info': 'The Latest Update\nChapter 1 love you only need 72 hours'}, {'title': 'Heroes Prison', 'url': 'https://www.machine-translation.org/novel/879886fb8ed5617e/heroes-prison.html', 'info': 'The Latest Update\ntext'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://www.machine-translation.org/novel/0c68fa356efbe0a3/shift-the-side-character-heroine.html', 'info': 'The Latest Update\nChapter 1 cameo'}, {'title': "Superhero Comic - Overlord's Path", 'url': 'https://www.machine-translation.org/novel/72779ef2c431c0dd/superhero-comic-overlords-path.html', 'info': 'The Latest Update\nI have 1 life'}, {'title': 'Hero without Blood or Tear', 'url': 'https://www.machine-translation.org/novel/8c8dec2c8e6fa3bd/hero-without-blood-or-tear.html', 'info': 'The Latest Update\nCHAPTER 1.'}, {'title': "Douluo Dalu 3.5 - Tang Sect's Heroes' Biography", 'url': 'https://www.machine-translation.org/novel/3483208b4f473dc1/douluo-dalu-35-tang-sects-heroes-biography.html', 'info': 'The Latest Update\nPalpitation Xiao Wu'}, {'title': 'During Those Years When I Was A Marvel Superhero', 'url': 'https://www.machine-translation.org/novel/e58929bd1da3a699/during-those-years-when-i-was-a-marvel-superhero.html', 'info': "The Latest Update\nsuperhero's world"}, {'title': 'God Rank Hero', 'url': 'https://www.machine-translation.org/novel/519f18efc8953f18/god-rank-hero.html', 'info': 'The Latest Update\nChapter 1'}, {'title': 'Dropped In the Marvel World As a Superhero', 'url': 'https://www.machine-translation.org/novel/ecf1e137cc81096b/dropped-in-the-marvel-world-as-a-superhero.html', 'info': 'The Latest Update\nMarvel World and strange Quest'}, {'title': 'Martial Hero Rebirth', 'url': 'https://www.machine-translation.org/novel/b86ce74cf08b726c/martial-hero-rebirth.html', 'info': 'The Latest Update\nEnd this testimonial!'}]
2021-07-28 20:47:21,559 [INFO] (lncrawl.core.novel_search)
10 results from https://www.machine-translation.org/
2021-07-28 20:47:21,561 [DEBUG] (urllib3.connectionpool)
https://www.novelall.com:443 "GET /search/?name=hero HTTP/1.1" 200 None
2021-07-28 20:47:21,595 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): novelgate.net:443
2021-07-28 20:47:21,724 [DEBUG] (urllib3.connectionpool)
https://clicknovel.net:443 "GET /?s=hero&post_type=wp-manga HTTP/1.1" 200 None
2021-07-28 20:47:21,779 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Anh hùng Vô chức', 'url': 'https://ln.hako.re/truyen/5399-mushoku-no-eiyuu-betsu-ni-skill-nanka-iranakattan-daga', 'info': 'Tập 1 WN | Chương 24: Tất cả những gì cần làm là đánh bại hết thôi'}, {'title': 'Anh hùng Vô Chức', 'url': 'https://ln.hako.re/truyen/9096-anh-hung-vo-chuc', 'info': 'Web Novel - tập 2 | Chap 8 – Xin hãy để con gọi người là sư phụ'}, {'title': 'Anh Hùng? Ta không làm lâu rồi', 'url': 'https://ln.hako.re/truyen/4751-anh-hung-ta-khong-lam-lau-roi', 'info': 'Tập 01 | Chương 01'}, {'title': 'Ankoku kishi monogatari~Yuusha wo taosu tameni Maou ni Shoukansaremashita~', 'url': 'https://ln.hako.re/convert/6820-ankoku-kishi-monogatariyuusha-wo-taosu-tameni-maou-ni-shoukansaremashita', 'info': 'Arc 8: Thành Phố Tử Thần (Đang tiến hành) | Chương 19: Đất nước bất lão'}, {'title': 'Ankoku kishi monogatari~Yuusha wo taosu tameni Maou ni Shoukansaremashita~', 'url': 'https://ln.hako.re/truyen/3009-ankoku-kishi-monogatari-yuusha-wo-taosu-tameni-maou-ni-shoukansaremashita', 'info': 'Act 4: Mê Lộ của Tà Thần | Chương 60.3: Nhân Ngưu trong Mê Cung'}, {'title': 'Ansatsusha de Aru Ore no Status ga Yuusha yori mo Akiraka ni Tsuyoi no daga', 'url': 'https://ln.hako.re/truyen/3144-ansatsusha-de-aru-ore-no-status-ga-yuusha-yori-mo-akiraka-ni-tsuyoi-no-daga', 'info': 'Web novel | Chương 116 - Lễ Hội III'}, {'title': 'Assassin de aru Ore no Status ga Yuusha Yorimo Akirakani Tsuyoi no daga', 'url': 'https://ln.hako.re/truyen/6616-assassin-de-aru-ore-no-status-ga-yuusha-yorimo-akirakani-tsuyoi-no-daga', 'info': 'Web Novel | Chương 121'}, {'title': 'Asuka of the scarlet sky', 'url': 'https://ln.hako.re/truyen/618-light-novel-asuka-of-the-scarlet-sky-18', 'info': 'Vol 1 | Chương 29: Kết cục'}, {'title': 'Asuka of the Scarlet Sky', 'url': 'https://ln.hako.re/truyen/3822-hai-nu-anh-hung-tren-ca-hai-tay', 'info': 'Vol 1 | Chương 32'}, {'title': 'Bad Hero', 'url': 'https://ln.hako.re/sang-tac/9359-bad-hero', 'info': 'Tập 01: Đại Lâm Viron | Chương 04'}, {'title': 'Breakthrough with the Forbidden Master', 'url': 'https://ln.hako.re/truyen/7015-breakthrough-with-the-forbidden-master', 'info': 'Tập 4 | Chương 141: Giật mình'}, {'title': 'Charging the Hero (Cáo buộc Anh Hùng)', 'url': 'https://ln.hako.re/truyen/2922-charging-the-hero-cao-buoc-anh-hung', 'info': 'Gặp Gỡ | Thăm viếng (13)'}, {'title': 'Dark Magician as a Hero', 'url': 'https://ln.hako.re/truyen/1149-dark-magician-as-a-hero', 'info': 'ILLUSTRATIONS | Tập 05'}, {'title': 'Demon King & Hero', 'url': 'https://ln.hako.re/truyen/3036-demon-king-hero', 'info': 'Volume 9 | Ngoại truyện mừng năm mới'}, {'title': 'Eiyu-oh, Bu wo Kiwameru tame Tensei su. Soshite, Sekai Saikyou no Minarai Kisi ♀', 'url': 'https://ln.hako.re/convert/9588-eiyu-oh-bu-wo-kiwameru-tame-tensei-su-soshite-sekai-saikyou-no-minarai-kisi', 'info': 'Volume 01 | PDF & Illustrations'}, {'title': 'Eiyuu no Musume to Shite Umarekawatta Eiyuu wa Futatabi Eiyuu o Mezasu (WN)', 'url': 'https://ln.hako.re/truyen/2504-eiyuu-no-musume-to-shite-umarekawatta-eiyuu-wa-futatabi-eiyuu-o-mezasu-wn', 'info': 'Nội dung | Chương 04: Bắt đầu lại cuộc đời'}, {'title': 'Eiyuu-ou, Bu wo Kiwameru tame Tensei su ~ Soshite, Sekai Saikyou no Minarai Kishi ♀ ~', 'url': 'https://ln.hako.re/truyen/7009-eiyuu-ou-bu-wo-kiwameru-tame-tensei-su-soshite-sekai-saikyou-no-minarai-kishi', 'info': 'Tập 01: Kiến Quốc Anh Hùng Vương(♂)→ Chuyển Sinh → Hiệp Sĩ Tập Sự Mạnh Mẽ Nhất(♀)!? ☪ | Chương 50: Inglis 15 Tuổi Và Hồng Vương Đóng Băng ⓺'}, {'title': 'Garbage Brave: Isekai Ni Shoukan Sare Suterareta Yuusha No Fukushuu Monogatari', 'url': 'https://ln.hako.re/truyen/6443-garbage-brave-isekai-ni-shoukan-sare-suterareta-yuusha-no-fukushuu-monogatari', 'info': 'Tập 03 | Chương 5: Kết thúc (Phần 4)'}, {'title': 'Hero x Maou', 'url': 'https://ln.hako.re/truyen/2521-hero-x-maou', 'info': 'Truyện chia theo chương | Ngoại truyện'}, {'title': 'Heroine na Imouto, Akuyaku Reijo na Watashi', 'url': 'https://ln.hako.re/truyen/1195-my-sister-the-heroine-and-i-the-villainess', 'info': 'Năm mười ba tuổi (74-88) | Chương 76'}, {'title': 'HeroxMaou', 'url': 'https://ln.hako.re/truyen/1856-heroxmaou', 'info': 'Tập 01 | THÔNG BÁO DROP CỦA TRANS'}, {'title': 'I Was Caught up in a Hero Summoning, but That World Is at Peace', 'url': 'https://ln.hako.re/truyen/7773-i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace', 'info': 'Web Novel | 172 - .'}, {'title': 'I Was Caught up in a Hero Summoning, but That World Is at Peace', 'url': 'https://ln.hako.re/truyen/2959-i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace', 'info': 'Tập 01 | Chương 05 Công tước là một người tốt (phần 2)'}, {'title': 'Kaette Kita Motoyuusha', 'url': 'https://ln.hako.re/truyen/326-kaette-kita-motoyuusha', 'info': 'Lãnh địa Ringland /Aria (134>143) | Chương 147: Cựu Anh Hùng – Đi làm việc'}]
2021-07-28 20:47:21,780 [INFO] (lncrawl.core.novel_search)
24 results from https://ln.hako.re/
2021-07-28 20:47:21,808 [DEBUG] (urllib3.connectionpool)
https://novelfull.com:443 "GET /search?keyword=hero HTTP/1.1" 200 None
2021-07-28 20:47:21,815 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.novelhunters.com:443
2021-07-28 20:47:22,018 [DEBUG] (urllib3.connectionpool)
https://novel27.com:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:22,051 [DEBUG] (urllib3.connectionpool)
https://fr.mtlnovel.com:443 "GET //wp-admin/admin-ajax.php?action=autosuggest&q=hero HTTP/1.1" 200 None
2021-07-28 20:47:22,078 [DEBUG] (urllib3.connectionpool)
Starting new HTTP connection (1): es.mtlnovel.com:80
2021-07-28 20:47:22,080 [DEBUG] (urllib3.connectionpool)
https://novelcake.com:443 "GET /?s=hero&post_type=wp-manga HTTP/1.1" 200 None
2021-07-28 20:47:22,185 [DEBUG] (urllib3.connectionpool)
http://es.mtlnovel.com:80 "GET //wp-admin/admin-ajax.php?action=autosuggest&q=hero HTTP/1.1" 301 None
2021-07-28 20:47:22,210 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): es.mtlnovel.com:443
2021-07-28 20:47:22,241 [DEBUG] (lncrawl.core.novel_search)
[]
2021-07-28 20:47:22,247 [INFO] (lncrawl.core.novel_search)
0 results from https://mysticalmerries.com/
2021-07-28 20:47:22,279 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.novelmultiverse.com:443
2021-07-28 20:47:22,303 [DEBUG] (urllib3.connectionpool)
https://lightnovel.tv:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:22,573 [DEBUG] (urllib3.connectionpool)
https://boxnovel.com:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:22,751 [DEBUG] (urllib3.connectionpool)
https://novelgate.net:443 "GET /search/hero HTTP/1.1" 200 None
2021-07-28 20:47:22,848 [DEBUG] (urllib3.connectionpool)
https://morenovel.net:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:22,866 [DEBUG] (urllib3.connectionpool)
https://es.mtlnovel.com:443 "GET //wp-admin/admin-ajax.php?action=autosuggest&q=hero HTTP/1.1" 200 None
2021-07-28 20:47:22,870 [DEBUG] (urllib3.connectionpool)
https://novelfullplus.com:443 "GET /ajax/search?q=hero HTTP/1.1" 302 None
2021-07-28 20:47:22,907 [DEBUG] (lncrawl.core.novel_search)
[{'url': 'https://www.mtlnovel.com/martial-hero-rebirth/', 'title': 'Martial Hero Rebirth'}, {'url': 'https://www.mtlnovel.com/quick-transmigration-heroine-arrives-woman-rapidly-retreats/', 'title': 'Quick Transmigration: Heroine Arrives, Woman Rapidly Retreats!'}, {'url': 'https://www.mtlnovel.com/heroes-of-marvel/', 'title': 'Heroes of Marvel'}, {'url': 'https://www.mtlnovel.com/heroic-wife-reborn/', 'title': 'Heroic Wife Reborn'}, {'url': 'https://www.mtlnovel.com/heroic-death-system/', 'title': 'Heroic Death System'}, {'url': 'https://www.mtlnovel.com/i-like-your-pheromones/', 'title': 'I Like Your Pheromones'}, {'url': 'https://www.mtlnovel.com/never-thought-youd-be-this-kind-of-hero/', 'title': 'Never Thought You’d Be This Kind of Hero!'}, {'url': 'https://www.mtlnovel.com/the-coming-heroine-the-only-princess/', 'title': 'The Coming Heroine: The Only Princess'}, {'url': 'https://www.mtlnovel.com/god-rank-hero/', 'title': 'God Rank Hero'}, {'url': 'https://www.mtlnovel.com/heroine-saves-a-gentleman/', 'title': 'Heroine Saves A Gentleman'}, {'url': 'https://id.mtlnovel.com/martial-hero-rebirth/', 'title': 'Martial Hero Rebirth'}, {'url': 'https://id.mtlnovel.com/quick-transmigration-heroine-arrives-woman-rapidly-retreats/', 'title': 'Quick Transmigration: Heroine Arrives, Woman Rapidly Retreats!'}, {'url': 'https://id.mtlnovel.com/heroes-of-marvel/', 'title': 'Heroes of Marvel'}, {'url': 'https://id.mtlnovel.com/heroic-wife-reborn/', 'title': 'Heroic Wife Reborn'}, {'url': 'https://id.mtlnovel.com/heroic-death-system/', 'title': 'Heroic Death System'}, {'url': 'https://id.mtlnovel.com/i-like-your-pheromones/', 'title': 'I Like Your Pheromones'}, {'url': 'https://id.mtlnovel.com/never-thought-youd-be-this-kind-of-hero/', 'title': 'Never Thought You’d Be This Kind of Hero!'}, {'url': 'https://id.mtlnovel.com/the-coming-heroine-the-only-princess/', 'title': 'The Coming Heroine: The Only Princess'}, {'url': 'https://id.mtlnovel.com/god-rank-hero/', 'title': 'God Rank Hero'}, {'url': 'https://id.mtlnovel.com/heroine-saves-a-gentleman/', 'title': 'Heroine Saves A Gentleman'}, {'url': 'https://fr.mtlnovel.com/martial-hero-rebirth/', 'title': 'Martial Hero Rebirth'}, {'url': 'https://fr.mtlnovel.com/quick-transmigration-heroine-arrives-woman-rapidly-retreats/', 'title': 'Quick Transmigration: Heroine Arrives, Woman Rapidly Retreats!'}, {'url': 'https://fr.mtlnovel.com/heroes-of-marvel/', 'title': 'Heroes of Marvel'}, {'url': 'https://fr.mtlnovel.com/heroic-wife-reborn/', 'title': 'Heroic Wife Reborn'}, {'url': 'https://fr.mtlnovel.com/heroic-death-system/', 'title': 'Heroic Death System'}, {'url': 'https://fr.mtlnovel.com/i-like-your-pheromones/', 'title': 'I Like Your Pheromones'}, {'url': 'https://fr.mtlnovel.com/never-thought-youd-be-this-kind-of-hero/', 'title': 'Never Thought You’d Be This Kind of Hero!'}, {'url': 'https://fr.mtlnovel.com/the-coming-heroine-the-only-princess/', 'title': 'The Coming Heroine: The Only Princess'}, {'url': 'https://fr.mtlnovel.com/god-rank-hero/', 'title': 'God Rank Hero'}, {'url': 'https://fr.mtlnovel.com/heroine-saves-a-gentleman/', 'title': 'Heroine Saves A Gentleman'}, {'url': 'https://es.mtlnovel.com/martial-hero-rebirth/', 'title': 'Martial Hero Rebirth'}, {'url': 'https://es.mtlnovel.com/quick-transmigration-heroine-arrives-woman-rapidly-retreats/', 'title': 'Quick Transmigration: Heroine Arrives, Woman Rapidly Retreats!'}, {'url': 'https://es.mtlnovel.com/heroes-of-marvel/', 'title': 'Heroes of Marvel'}, {'url': 'https://es.mtlnovel.com/heroic-wife-reborn/', 'title': 'Heroic Wife Reborn'}, {'url': 'https://es.mtlnovel.com/heroic-death-system/', 'title': 'Heroic Death System'}, {'url': 'https://es.mtlnovel.com/i-like-your-pheromones/', 'title': 'I Like Your Pheromones'}, {'url': 'https://es.mtlnovel.com/never-thought-youd-be-this-kind-of-hero/', 'title': 'Never Thought You’d Be This Kind of Hero!'}, {'url': 'https://es.mtlnovel.com/the-coming-heroine-the-only-princess/', 'title': 'The Coming Heroine: The Only Princess'}, {'url': 'https://es.mtlnovel.com/god-rank-hero/', 'title': 'God Rank Hero'}, {'url': 'https://es.mtlnovel.com/heroine-saves-a-gentleman/', 'title': 'Heroine Saves A Gentleman'}]
2021-07-28 20:47:22,916 [INFO] (lncrawl.core.novel_search)
40 results from http://www.mtlnovel.com/
2021-07-28 20:47:22,976 [DEBUG] (lncrawl.core.crawler)
POST url=https://novelonlinefree.com/getsearchstory, data={'searchword': 'hero'}, headers={'content-type': 'application/x-www-form-urlencoded; charset=UTF-8'}
2021-07-28 20:47:22,987 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): novelonlinefree.com:443
2021-07-28 20:47:23,000 [DEBUG] (urllib3.connectionpool)
https://listnovel.com:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:23,126 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Hero Returns', 'url': 'http://novelfull.com/the-hero-returns.html', 'info': 'Chapter 383'}, {'title': 'Heroes of Marvel', 'url': 'http://novelfull.com/heroes-of-marvel.html', 'info': 'CHAPTER 667 VISI'}, {'title': 'I Was Kicked out of the Hero’s Party Because I Wasn’t a True Companion so I Decided to Have a Slow Life at the Frontier', 'url': 'http://novelfull.com/i-was-kicked-out-of-the-heros-party-because-i-wasnt-a-true-companion-so-i-decided-to-have-a-slow-life-at-the-frontier.html', 'info': 'Chapter 163 - Gideon’s answer'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'http://novelfull.com/shift-the-side-character-heroine.html', 'info': 'Chapter 773 (END) - The Eternal Heroine (Grand Finale)'}]
2021-07-28 20:47:23,136 [INFO] (lncrawl.core.novel_search)
4 results from http://novelfull.com/
2021-07-28 20:47:23,177 [DEBUG] (lncrawl.core.crawler)
POST url=https://novelonlinefull.com/getsearchstory, data={'searchword': 'hero'}, headers={'content-type': 'application/x-www-form-urlencoded; charset=UTF-8'}
2021-07-28 20:47:23,198 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): novelonlinefull.com:443
2021-07-28 20:47:23,497 [DEBUG] (urllib3.connectionpool)
https://novelfullplus.com:443 "GET / HTTP/1.1" 200 None
2021-07-28 20:47:23,533 [DEBUG] (lncrawl.core.novel_search)
[{'url': 'https://www.novelall.com/novel/The-Laid-back-Life-in-Another-World-of-the-Ex-Hero-Candidate-Who-Turned-out-to-be-a-Cheat-from-Level-2.html', 'title': 'The Laid-back Life In Another World Of The Ex-Hero Candidate Who Turned Out To Be A Cheat From Level 2'}, {'url': 'https://www.novelall.com/novel/Heaven-8217-s-Glittering-Saint-Princess-Futanari-Training-of-the-Mother-and-Daughter-Heroines.html', 'title': 'Heaven’s Glittering Saint Princess ~Futanari Training Of The Mother And Daughter Heroines~'}, {'url': 'https://www.novelall.com/novel/My-Status-as-an-Assassin-Obviously-Exceeds-the-Hero-8217-s.html', 'title': 'My Status As An Assassin Obviously Exceeds The Hero’s'}, {'url': 'https://www.novelall.com/novel/A-Maiden-8217-s-Unwanted-Heroic-Epic.html', 'title': 'A Maiden’s Unwanted Heroic Epic'}, {'url': 'https://www.novelall.com/novel/I-Was-Dismissed-from-the-Hero-8217-s-Party-Because-They-Don-8217-t-Need-My-Training-Skills-so-I-Strengthen-My-Fief-Which-I-Got-as-a-Replacement-for-My-Retirement-Money.html', 'title': 'I Was Dismissed From The Hero’s Party Because They Don’t Need My Training Skills, So I Strengthen My [Fief] Which I Got As A Replacement For My Retirement Money.'}, {'url': 'https://www.novelall.com/novel/Treacherous-Living-in-the-Imperial-Harem.html', 'title': 'Treacherous Living In The Imperial Harem'}, {'url': 'https://www.novelall.com/novel/The-Strongest-Prophet-Who-Had-Trained-100-Heroes-is-Admired-By-His-Apprentices-Around-The-World-Even-As-An-Adventurer.html', 'title': 'The Strongest Prophet Who Had Trained 100 Heroes Is Admired By His Apprentices Around The World Even As An Adventurer'}, {'url': 'https://www.novelall.com/novel/Corporate-Slave-Hero-Says-He-s-Quitting-His-Job.html', 'title': 'Corporate Slave Hero Says He’s Quitting His Job'}, {'url': 'https://www.novelall.com/novel/Strange-Grief-Wants-to-Retire-The-Weakest-Hunter-8217-s-Hero-Dream.html', 'title': 'Strange Grief Wants To Retire ~ The Weakest Hunter’s Hero Dream'}, {'url': 'https://www.novelall.com/novel/My-Lover-Was-Stolen-And-I-Was-Kicked-Out-Of-The-Hero-8217-s-Party-But-I-Awakened-To-The-EX-Skill-Fixed-Damage-And-Became-Invincible-Now-Let-8217-s-Begin-Some-Revenge.html', 'title': 'My Lover Was Stolen, And I Was Kicked Out Of The Hero’s Party, But I Awakened To The EX Skill “Fixed Damage” And Became Invincible. Now, Let’s Begin Some Revenge'}, {'url': 'https://www.novelall.com/novel/Reborn-as-the-Hero-s-Daughter-Time-to-Become-the-Hero-Once-More-WN.html', 'title': 'Reborn As The Hero’s Daughter! Time To Become The Hero Once More! (WN)'}, {'url': 'https://www.novelall.com/novel/Heroine-Saves-A-Gentleman.html', 'title': 'Heroine Saves A Gentleman'}, {'url': 'https://www.novelall.com/novel/Today-8217-s-Dinner-is-the-Hero.html', 'title': 'Today’s Dinner Is The Hero'}, {'url': 'https://www.novelall.com/novel/As-the-Communication-Hero-I-Formed-the-World-8217-s-Strongest-Party-with-a-Cool-Big-Sister.html', 'title': 'As The Communication Hero, I Formed The World’s Strongest Party With A Cool Big Sister'}, {'url': 'https://www.novelall.com/novel/Corporate-S-ave-Hero-Says-He-s-Quitting-His-Job.html', 'title': 'Corporate S*ave Hero Says He’s Quitting His Job'}, {'url': 'https://www.novelall.com/novel/An-Unemployed-Small-Town-Girl-Pulled-Out-The-Enchanted-Sword-She-Can-8217-t-Become-The-Hero-So-She-8217-ll-Become-the-Demon-King-Instead.html', 'title': 'An Unemployed Small-Town Girl Pulled Out The Enchanted Sword: She Can’t Become The Hero, So She’ll Become The Demon King Instead'}, {'url': 'https://www.novelall.com/novel/From-The-Strongest-Job-of-Dragon-Knight-To-The-Beginner-Job-Carrier-Somehow-The-Heroes-are-Depending-on-Me.html', 'title': 'From The Strongest Job Of Dragon Knight, To The Beginner Job Carrier, Somehow, The Heroes Are Depending On Me'}, {'url': 'https://www.novelall.com/novel/The-Traveling-Hero-Won-8217-t-Let-the-Innkeeper-8217-s-Son-Escape.html', 'title': 'The Traveling Hero Won’t Let The Innkeeper’s Son Escape'}, {'url': 'https://www.novelall.com/novel/After-the-Hero-Broke-the-Engagement-With-Me-the-Village-Girl-I-Became-an-Amateur-Tamer-but-I-Can-Tame-People-Too.html', 'title': 'After The Hero Broke The Engagement With Me, The Village Girl, I Became An Amateur Tamer, But I Can Tame People Too!'}, {'url': 'https://www.novelall.com/novel/I-Like-Your-Pheromones.html', 'title': 'I Like Your Pheromones'}]
2021-07-28 20:47:23,537 [INFO] (lncrawl.core.novel_search)
20 results from https://www.novelall.com/
2021-07-28 20:47:23,619 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'World Defying Dan God', 'url': 'https://lightnovelshub.com/novel/world-defying-dan-god/', 'info': 'WORLD DEFYING DAN GOD Chapter 3820 | Rating: 5'}, {'title': 'Tales of Demons and Gods', 'url': 'https://lightnovelshub.com/novel/tales-of-demons-and-gods/', 'info': 'TALES OF DEMONS AND GODS Chapter 496 | Rating: 5'}, {'title': 'Great Demon King', 'url': 'https://lightnovelshub.com/novel/great-demon-king/', 'info': 'GREAT DEMON KING Chapter 991 | Rating: 5'}, {'title': 'Dungeon Defense', 'url': 'https://lightnovelshub.com/novel/dungeon-defense/', 'info': ' DUNGEON DEFENSE Chapter 43 (END) - Vol | Rating: 5'}, {'title': 'Otherworldly Evil Monarch', 'url': 'https://lightnovelshub.com/novel/otherworldly-evil-monarch/', 'info': 'OTHERWORLDLY EVIL MONARCH Chapter 1277 | Rating: 5'}, {'title': 'Transcending The Nine Heavens', 'url': 'https://lightnovelshub.com/novel/transcending-the-nine-heavens/', 'info': 'TRANSCENDING THE NINE HEAVENS Chapter 1483 | Rating: 5'}, {'title': 'Ze Tian Ji', 'url': 'https://lightnovelshub.com/novel/ze-tian-ji/', 'info': 'ZE TIAN JI Chapter 1183 | Rating: 5'}, {'title': 'Absolute Choice Novel | Read Online For Free', 'url': 'https://lightnovelshub.com/novel/absolute-choice-novel-read-online-for-free/', 'info': 'ABSOLUTE CHOICE Chapter 583 | Rating: 5'}, {'title': 'I Reincarnated For Nothing', 'url': 'https://lightnovelshub.com/novel/i-reincarnated-for-nothing/', 'info': 'I REINCARNATED FOR NOTHING Chapter 203 | Rating: 5'}, {'title': 'Battle Frenzy', 'url': 'https://lightnovelshub.com/novel/battle-frenzy/', 'info': 'BATTLE FRENZY Chapter 1167 | Rating: 5'}]
2021-07-28 20:47:23,622 [INFO] (lncrawl.core.novel_search)
10 results from https://lightnovelshub.com/
2021-07-28 20:47:23,743 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.novelpassion.com:443
2021-07-28 20:47:23,754 [DEBUG] (urllib3.connectionpool)
Starting new HTTP connection (1): novels.cloud:80
2021-07-28 20:47:23,916 [DEBUG] (urllib3.connectionpool)
https://novelonlinefree.com:443 "POST /getsearchstory HTTP/1.1" 200 None
2021-07-28 20:47:23,933 [DEBUG] (urllib3.connectionpool)
https://www.mywuxiaworld.com:443 "GET /search/result.html?searchkey=hero HTTP/1.1" 520 None
2021-07-28 20:47:24,028 [DEBUG] (root)
Searching failure for https://www.mywuxiaworld.com/
2021-07-28 20:47:24,147 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): novelsite.net:443
2021-07-28 20:47:24,197 [DEBUG] (urllib3.connectionpool)
https://novelonlinefull.com:443 "POST /getsearchstory HTTP/1.1" 200 None
2021-07-28 20:47:24,328 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Monster Paradise', 'url': 'https://novelgate.net/monster-paradise2-47/', 'info': 'Chapter 1598'}, {'title': 'Second Life Ranker', 'url': 'https://novelgate.net/second-life-ranker-130/', 'info': 'Chapter 525'}, {'title': 'Guild Wars', 'url': 'https://novelgate.net/guild-wars2-63/', 'info': 'Chapter 544'}, {'title': 'The Insurrection Of The Inept Hero', 'url': 'https://novelgate.net/the-insurrection-of-the-inept-hero-185/', 'info': 'Chapter 113'}, {'title': "The Villain's Redemption", 'url': 'https://novelgate.net/the-villains-redemption4-113/', 'info': 'Chapter 292'}, {'title': 'Reincarnated As The Hero Ring', 'url': 'https://novelgate.net/reincarnated-as-the-hero-ring1-29/', 'info': 'Chapter 202'}, {'title': 'Human King', 'url': 'https://novelgate.net/human-king1-147/', 'info': 'Chapter 215'}, {'title': 'Hero Extraction System', 'url': 'https://novelgate.net/hero-extraction-system-7/', 'info': 'Chapter 74'}]
2021-07-28 20:47:24,343 [DEBUG] (urllib3.connectionpool)
https://www.novelmultiverse.com:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:24,370 [INFO] (lncrawl.core.novel_search)
8 results from https://novelgate.net/
2021-07-28 20:47:24,387 [DEBUG] (root)
Searching failure for https://www.foxaholic.com/
2021-07-28 20:47:24,438 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Amber Sword', 'url': 'https://novelonlinefree.com/novel/the_amber_sword', 'info': 'Latest: Chapter 761 - v4c135 Breaking Cocoon (2)'}, {'title': 'Kill The Hero', 'url': 'https://novelonlinefree.com/novel/kill_the_hero', 'info': 'Latest: Chapter 275'}, {'title': 'Quick Transmigration: Heroine Arrives, Woman Rapidly Retreats!', 'url': 'https://novelonlinefree.com/novel/quick_transmigration_heroine_arrives_woman_rapidly_retreats', 'info': 'Latest: Chapter 333'}, {'title': 'Will The Re-Summoned Hero Live As An Ordinary Person', 'url': 'https://novelonlinefree.com/novel/will_the_resummoned_hero_live_as_an_ordinary_person', 'info': 'Latest: Chapter 114'}, {'title': 'Ex-Hero Candidate’S, Who Turned Out To Be A Cheat From Lv2, Laid-Back Life In Another World', 'url': 'https://novelonlinefree.com/novel/exhero_candidates_who_turned_out_to_be_a_cheat_from_lv2_laidback_life_in_another_world', 'info': 'Latest: Chapter 83'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://novelonlinefree.com/novel/shift_the_sidecharacter_heroine', 'info': 'Latest: Chapter 764 - A Laughing Stock?'}, {'title': 'Return Of The Former Hero', 'url': 'https://novelonlinefree.com/novel/return_of_the_former_hero', 'info': 'Latest: Chapter 153'}, {'title': "I Was Kicked Out Of The Hero'S Party Because I Wasn'T A True Companion So I Decided To Have A Slow Life At The Frontier", 'url': 'https://novelonlinefree.com/novel/i_was_kicked_out_of_the_heros_party_because_i_wasnt_a_true_companion_so_i_decided_to_have_a_slow_life_at_the_frontier', 'info': 'Latest: Chapter 163 - Gideon’s answer'}, {'title': 'The Hero Returns', 'url': 'https://novelonlinefree.com/novel/the_hero_returns', 'info': 'Latest: Chapter 383'}, {'title': 'Heroes Of Marvel', 'url': 'https://novelonlinefree.com/novel/heroes_of_marvel', 'info': 'Latest: CHAPTER 667 VISI'}, {'title': "My Status As An Assassin Obviously Exceeds The Hero'S", 'url': 'https://novelonlinefree.com/novel/my_status_as_an_assassin_obviously_exceeds_the_heros', 'info': 'Latest: Chapter 138'}, {'title': 'Asuka Of The Scarlet Sky', 'url': 'https://novelonlinefree.com/novel/asuka_of_the_scarlet_sky', 'info': 'Latest: Chapter 77'}, {'title': 'Suterareta Yuusha No Eiyuutan', 'url': 'https://novelonlinefree.com/novel/suterareta_yuusha_no_eiyuutan', 'info': 'Latest: Volume 4 Chapter 15'}, {'title': 'Methods To Save The Villain Who Was Abandoned By The Heroine', 'url': 'https://novelonlinefree.com/novel/zkp8054792241555402699', 'info': 'Latest: Chapter 13'}, {'title': 'Fff-Class Trashero', 'url': 'https://novelonlinefree.com/novel/fffclass_trashero', 'info': 'Latest: Chapter 111'}, {'title': 'Heroic Wife Reborn', 'url': 'https://novelonlinefree.com/novel/cxy1819458541570675324', 'info': "Latest: Chapter 138: The Young Women In The Monk''s Temple"}, {'title': 'Sendai Yuusha Wa Inkyou Shitai', 'url': 'https://novelonlinefree.com/novel/sendai_yuusha_wa_inkyou_shitai', 'info': 'Latest: Chapter 164'}, {'title': 'Harassing Thief Girl', 'url': 'https://novelonlinefree.com/novel/harassing_thief_girl', 'info': 'Latest: Chapter 166'}, {'title': 'The Hero Proposed To Me', 'url': 'https://novelonlinefree.com/novel/kth4800505051564797286', 'info': 'Latest: Chapter 5'}, {'title': 'Shinwa Densetsu No Eiyuu No Isekaitan', 'url': 'https://novelonlinefree.com/novel/shinwa_densetsu_no_eiyuu_no_isekaitan', 'info': 'Latest: Vol 3 Chapter 6'}]
2021-07-28 20:47:24,481 [INFO] (lncrawl.core.novel_search)
20 results from https://novelonlinefree.com/
2021-07-28 20:47:24,485 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.novels.pl:443
2021-07-28 20:47:24,534 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): novelsrock.com:443
2021-07-28 20:47:24,584 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): noveltoon.mobi:443
2021-07-28 20:47:24,618 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Amber Sword', 'url': 'https://novelonlinefull.com/novel/the_amber_sword', 'info': 'Latest: Chapter 761 - v4c135 Breaking Cocoon (2)'}, {'title': 'Kill The Hero', 'url': 'https://novelonlinefull.com/novel/kill_the_hero', 'info': 'Latest: Chapter 275'}, {'title': 'Quick Transmigration: Heroine Arrives, Woman Rapidly Retreats!', 'url': 'https://novelonlinefull.com/novel/quick_transmigration_heroine_arrives_woman_rapidly_retreats', 'info': 'Latest: Chapter 333'}, {'title': 'Will The Re-Summoned Hero Live As An Ordinary Person', 'url': 'https://novelonlinefull.com/novel/will_the_resummoned_hero_live_as_an_ordinary_person', 'info': 'Latest: Chapter 114'}, {'title': 'Ex-Hero Candidate’S, Who Turned Out To Be A Cheat From Lv2, Laid-Back Life In Another World', 'url': 'https://novelonlinefull.com/novel/exhero_candidates_who_turned_out_to_be_a_cheat_from_lv2_laidback_life_in_another_world', 'info': 'Latest: Chapter 83'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://novelonlinefull.com/novel/shift_the_sidecharacter_heroine', 'info': 'Latest: Chapter 764 - A Laughing Stock?'}, {'title': 'Return Of The Former Hero', 'url': 'https://novelonlinefull.com/novel/return_of_the_former_hero', 'info': 'Latest: Chapter 153'}, {'title': "I Was Kicked Out Of The Hero'S Party Because I Wasn'T A True Companion So I Decided To Have A Slow Life At The Frontier", 'url': 'https://novelonlinefull.com/novel/i_was_kicked_out_of_the_heros_party_because_i_wasnt_a_true_companion_so_i_decided_to_have_a_slow_life_at_the_frontier', 'info': 'Latest: Chapter 163 - Gideon’s answer'}, {'title': 'The Hero Returns', 'url': 'https://novelonlinefull.com/novel/the_hero_returns', 'info': 'Latest: Chapter 383'}, {'title': 'Heroes Of Marvel', 'url': 'https://novelonlinefull.com/novel/heroes_of_marvel', 'info': 'Latest: CHAPTER 667 VISI'}, {'title': "My Status As An Assassin Obviously Exceeds The Hero'S", 'url': 'https://novelonlinefull.com/novel/my_status_as_an_assassin_obviously_exceeds_the_heros', 'info': 'Latest: Chapter 138'}, {'title': 'Asuka Of The Scarlet Sky', 'url': 'https://novelonlinefull.com/novel/asuka_of_the_scarlet_sky', 'info': 'Latest: Chapter 77'}, {'title': 'Suterareta Yuusha No Eiyuutan', 'url': 'https://novelonlinefull.com/novel/suterareta_yuusha_no_eiyuutan', 'info': 'Latest: Volume 4 Chapter 15'}, {'title': 'Methods To Save The Villain Who Was Abandoned By The Heroine', 'url': 'https://novelonlinefull.com/novel/zkp8054792241555402699', 'info': 'Latest: Chapter 13'}, {'title': 'Fff-Class Trashero', 'url': 'https://novelonlinefull.com/novel/fffclass_trashero', 'info': 'Latest: Chapter 111'}, {'title': 'Heroic Wife Reborn', 'url': 'https://novelonlinefull.com/novel/cxy1819458541570675324', 'info': "Latest: Chapter 138: The Young Women In The Monk''s Temple"}, {'title': 'Sendai Yuusha Wa Inkyou Shitai', 'url': 'https://novelonlinefull.com/novel/sendai_yuusha_wa_inkyou_shitai', 'info': 'Latest: Chapter 164'}, {'title': 'Harassing Thief Girl', 'url': 'https://novelonlinefull.com/novel/harassing_thief_girl', 'info': 'Latest: Chapter 166'}, {'title': 'The Hero Proposed To Me', 'url': 'https://novelonlinefull.com/novel/kth4800505051564797286', 'info': 'Latest: Chapter 5'}, {'title': 'Shinwa Densetsu No Eiyuu No Isekaitan', 'url': 'https://novelonlinefull.com/novel/shinwa_densetsu_no_eiyuu_no_isekaitan', 'info': 'Latest: Vol 3 Chapter 6'}]
2021-07-28 20:47:24,634 [INFO] (lncrawl.core.novel_search)
20 results from https://novelonlinefull.com/
2021-07-28 20:47:24,657 [DEBUG] (urllib3.connectionpool)
https://www.novelpassion.com:443 "GET /search?keyword=hero HTTP/1.1" 200 None
2021-07-28 20:47:24,706 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): noveltranslate.com:443
2021-07-28 20:47:24,726 [DEBUG] (urllib3.connectionpool)
https://www.novelhunters.com:443 "GET /?s=hero&post_type=wp-manga&op=&author=&artist=&release=&adult= HTTP/1.1" 200 None
2021-07-28 20:47:25,011 [DEBUG] (urllib3.connectionpool)
http://novels.cloud:80 "GET /search?keyword=hero HTTP/1.1" 200 None
2021-07-28 20:47:25,863 [DEBUG] (urllib3.connectionpool)
https://noveltoon.mobi:443 "GET /en/search?word=hero&source=&lock= HTTP/1.1" 200 None
2021-07-28 20:47:25,977 [DEBUG] (urllib3.connectionpool)
https://novelsite.net:443 "GET /?s=hero&post_type=wp-manga HTTP/1.1" 200 None
2021-07-28 20:47:26,380 [DEBUG] (urllib3.connectionpool)
https://1stkissnovel.love:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:26,468 [DEBUG] (lncrawl.core.novel_search)
[{'url': 'https://noveltoon.mobi/en/detail/283047/comments', 'title': 'My Hero Academia, Life In The Dorms', 'info': 'Romance, Comedy, Adventure'}]
2021-07-28 20:47:26,469 [INFO] (lncrawl.core.novel_search)
1 results from https://noveltoon.mobi/
2021-07-28 20:47:26,511 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): noveltrench.com:443
2021-07-28 20:47:26,569 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Bluebird Lady and The White Lion Family', 'url': 'https://novelcake.com/series/bluebird-lady-and-the-white-lion-family/', 'info': 'Chapter 3 | Rating: 5'}, {'title': '108 Maidens of Destiny', 'url': 'https://novelcake.com/series/108-maidens-of-destiny/', 'info': 'Prologue | Rating: 5'}, {'title': 'Trash of the Count’s Family (Web Novel)', 'url': 'https://novelcake.com/series/trash-of-the-counts-family-web-novel/', 'info': 'Chapter 677 | Rating: 3.8'}, {'title': 'Death Is The Only Ending For The Villainess', 'url': 'https://novelcake.com/series/death-is-the-only-ending-for-the-villainess/', 'info': 'Chapter 231 | Rating: 4.4'}]
2021-07-28 20:47:26,577 [INFO] (lncrawl.core.novel_search)
4 results from https://novelcake.com/
2021-07-28 20:47:26,615 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.novelupdates.cc:443
2021-07-28 20:47:27,326 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Hero Returns', 'url': 'https://lightnovelheaven.com/series/the-hero-returns/', 'info': 'Chapter 383 | Rating: 5'}, {'title': 'Heroine Saves A Gentleman', 'url': 'https://lightnovelheaven.com/series/heroine-saves-a-gentleman/', 'info': 'Chapter 152 | Rating: 4.7'}, {'title': 'The Way to Protect the Female Lead’s Older Brother', 'url': 'https://lightnovelheaven.com/series/the-way-to-protect-the-female-leads-older-brother/', 'info': 'Chapter 17 | Rating: 4.8'}, {'title': 'You’ve Got The Wrong House, Villain', 'url': 'https://lightnovelheaven.com/series/youve-got-the-wrong-house-villain/', 'info': 'Chapter 181 | Rating: 4.8'}, {'title': 'I Raised an Obsessive Servant', 'url': 'https://lightnovelheaven.com/series/i-raised-an-obsessive-servant/', 'info': 'Chapter 27 | Rating: 4.8'}, {'title': 'Death Is The Only Ending For The Villain', 'url': 'https://lightnovelheaven.com/series/death-is-the-only-ending-for-the-villain/', 'info': 'Side Story C8 | Rating: 4.7'}, {'title': 'The Baby Isn’t Yours', 'url': 'https://lightnovelheaven.com/series/the-baby-isnt-yours/', 'info': 'Chapter 17\xa0 | Rating: 4.3'}, {'title': 'I Adopted A Villainous Dad', 'url': 'https://lightnovelheaven.com/series/i-adopted-a-villainous-dad/', 'info': 'Chapter 13 | Rating: 4.9'}, {'title': '1st Kiss Was Intentional', 'url': 'https://lightnovelheaven.com/series/1st-kiss-was-intentional/', 'info': 'Chapter 13 | Rating: 4.8'}, {'title': 'The Villain’s Sister Suffers Today', 'url': 'https://lightnovelheaven.com/series/the-villains-sister-suffers-today/', 'info': 'Side Story 41 | Rating: 4.4'}, {'title': 'I’m a Villainess But So Popular', 'url': 'https://lightnovelheaven.com/series/im-a-villainess-but-so-popular/', 'info': 'Chapter 156 | Rating: 4.5'}, {'title': 'I Became the Wife of the Monstrous Crown Prince', 'url': 'https://lightnovelheaven.com/series/i-became-the-wife-of-the-monstrous-crown-prince/', 'info': 'Chapter 175 | Rating: 4.7'}, {'title': 'Dragon-Marked War God', 'url': 'https://lightnovelheaven.com/series/dragon-marked-war-god/', 'info': 'Chapter 2852 | Rating: 3'}, {'title': 'The Good for Nothing Seventh Miss', 'url': 'https://lightnovelheaven.com/series/the-good-for-nothing-seventh-miss/', 'info': 'Chapter 1200 | Rating: 4.9'}, {'title': 'Jujutsushi Wa Yuusha Ni Narenai', 'url': 'https://lightnovelheaven.com/series/jujutsushi-wa-yuusha-ni-narenai/', 'info': 'Chapter\xa0109 | Rating: 5'}, {'title': 'Disciple of Immortal', 'url': 'https://lightnovelheaven.com/series/disciple-of-immortal/', 'info': 'Chapter 39 | Rating: 5'}, {'title': 'Ankoku Kishi Monogatari', 'url': 'https://lightnovelheaven.com/series/ankoku-kishi-monogatari/', 'info': 'Chapter 59.1 | Rating: 5'}]
2021-07-28 20:47:27,336 [INFO] (lncrawl.core.novel_search)
17 results from https://lightnovelheaven.com/
2021-07-28 20:47:27,375 [DEBUG] (urllib3.connectionpool)
https://www.novelupdates.cc:443 "GET /search/hero/1 HTTP/1.1" 200 34155
2021-07-28 20:47:27,383 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): omgnovels.com:443
2021-07-28 20:47:27,549 [DEBUG] (urllib3.connectionpool)
https://novelsrock.com:443 "GET /?s=hero&post_type=wp-manga&op=&author=&artist=&release=&adult= HTTP/1.1" 200 None
2021-07-28 20:47:27,561 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'I Was Kicked out of the Hero’s Party Because I Wasn’t a True Companion so I Decided to Have a Slow Life at the Frontier', 'url': 'https://www.novelpassion.com/novel/i-was-kicked-out-of-the-hero-s-party-because-i-wasn-t-a-true-companion-so-i-decided-to-have-a-slow-life-at-the-frontier', 'info': 'Rating: 3.9'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://www.novelpassion.com/novel/shift-the-side-character-heroine', 'info': 'Rating: 4.2'}, {'title': 'Heroes of Marvel', 'url': 'https://www.novelpassion.com/novel/heroes-of-marvel', 'info': 'Rating: 4.2'}, {'title': 'The Hero Returns', 'url': 'https://www.novelpassion.com/novel/the-hero-returns-759', 'info': 'Rating: 4.3'}]
2021-07-28 20:47:27,569 [INFO] (lncrawl.core.novel_search)
4 results from https://www.novelpassion.com/
2021-07-28 20:47:27,609 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): overabook.com:443
2021-07-28 20:47:27,812 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Heroes Shed No Tears', 'url': 'http://novels.cloud/novel/heroes-shed-no-tears', 'info': 'Latest chapter: Chapter 18: Heroes Never Die'}, {'title': 'The Laid-back Life in Another World of the Ex-Hero Candidate Who Turned out to be a Cheat from Level 2', 'url': 'http://novels.cloud/novel/the-laid-back-life-in-another-world-of-the-ex-hero-candidate-who-turned-out-to-be-a-cheat-from-level-2', 'info': 'Latest chapter: Chapter 103'}, {'title': 'The Hero Returns', 'url': 'http://novels.cloud/novel/the-hero-returns', 'info': 'Latest chapter: Chapter 383'}, {'title': 'Heroes of Marvel', 'url': 'http://novels.cloud/novel/heroes-of-marvel', 'info': 'Latest chapter: CHAPTER 667 VISI'}, {'title': "I Was Kicked out of the Hero's Party Because I Wasn't a True Companion so I Decided to Have a Slow Life at the Frontier", 'url': 'http://novels.cloud/novel/i-was-kicked-out-of-the-heros-party-because-i-wasnt-a-true-companion-so-i-decided-to-have-a-slow-life-at-the-frontier', 'info': 'Latest chapter: Chapter 163 - Gideon’s answer'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'http://novels.cloud/novel/shift-the-side-character-heroine', 'info': 'Latest chapter: Chapter 773 (END) - The Eternal Heroine (Grand Finale)'}, {'title': "Hero? I've Long Stopped Being One", 'url': 'http://novels.cloud/novel/hero-ive-long-stopped-being-one', 'info': 'Latest chapter: Chapter 3'}, {'title': 'My Hero', 'url': 'http://novels.cloud/novel/my-hero', 'info': 'Latest chapter: short story (END)'}, {'title': 'Running Away From The Hero! (Remake)', 'url': 'http://novels.cloud/novel/running-away-from-the-hero-remake', 'info': 'Latest chapter: Chapter 120'}, {'title': 'My Sister the Heroine, and I the Villainess', 'url': 'http://novels.cloud/novel/my-sister-the-heroine-and-i-the-villainess', 'info': 'Latest chapter: Chapter 115'}]
2021-07-28 20:47:27,838 [INFO] (lncrawl.core.novel_search)
10 results from http://novels.cloud/
2021-07-28 20:47:27,819 [DEBUG] (urllib3.connectionpool)
https://noveltrench.com:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:27,892 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): toc.qidianunderground.org:443
2021-07-28 20:47:28,074 [DEBUG] (root)
Searching failure for https://overabook.com/
2021-07-28 20:47:28,144 [DEBUG] (lncrawl.sources.readlightnovelcc)
Visiting https://www.readlightnovel.cc/search/hero/1
2021-07-28 20:47:28,154 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.readlightnovel.cc:443
2021-07-28 20:47:28,395 [DEBUG] (urllib3.connectionpool)
https://noveltranslate.com:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:28,421 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Novel List', 'url': ' https://novelfullplus.com/ajax/search?q=hero/#'}, {'title': 'Latest Release', 'url': 'https://novelfullplus.com/sort/latest/'}, {'title': 'Hot Novel', 'url': 'https://novelfullplus.com/sort/hot/'}, {'title': 'Completed Novel', 'url': 'https://novelfullplus.com/sort/completed/'}, {'title': 'Most Popular', 'url': 'https://novelfullplus.com/sort/popular-novels/'}, {'title': 'Genre', 'url': ' https://novelfullplus.com/ajax/search?q=hero/#'}, {'title': 'Action', 'url': 'https://novelfullplus.com/genres/action'}, {'title': 'Adult', 'url': 'https://novelfullplus.com/genres/adult'}, {'title': 'Adventure', 'url': 'https://novelfullplus.com/genres/adventure'}, {'title': 'Ai', 'url': 'https://novelfullplus.com/genres/ai'}, {'title': 'Arts', 'url': 'https://novelfullplus.com/genres/arts'}, {'title': 'Bender', 'url': 'https://novelfullplus.com/genres/bender'}, {'title': 'Comedy', 'url': 'https://novelfullplus.com/genres/comedy'}, {'title': 'Drama', 'url': 'https://novelfullplus.com/genres/drama'}, {'title': 'Ecchi', 'url': 'https://novelfullplus.com/genres/ecchi'}, {'title': 'Fantasy', 'url': 'https://novelfullplus.com/genres/fantasy'}, {'title': 'Game', 'url': 'https://novelfullplus.com/genres/game'}, {'title': 'Gender', 'url': 'https://novelfullplus.com/genres/gender'}, {'title': 'Gender Bender', 'url': 'https://novelfullplus.com/genres/gender+bender'}, {'title': 'Harem', 'url': 'https://novelfullplus.com/genres/harem'}, {'title': 'Historical', 'url': 'https://novelfullplus.com/genres/historical'}, {'title': 'History', 'url': 'https://novelfullplus.com/genres/history'}, {'title': 'Horror', 'url': 'https://novelfullplus.com/genres/horror'}, {'title': 'Josei', 'url': 'https://novelfullplus.com/genres/josei'}, {'title': 'Lolicon', 'url': 'https://novelfullplus.com/genres/lolicon'}, {'title': 'Martial', 'url': 'https://novelfullplus.com/genres/martial'}, {'title': 'Martial Arts', 'url': 'https://novelfullplus.com/genres/martial+arts'}, {'title': 'Mature', 'url': 'https://novelfullplus.com/genres/mature'}, {'title': 'Mecha', 'url': 'https://novelfullplus.com/genres/mecha'}, {'title': 'Modern Life', 'url': 'https://novelfullplus.com/genres/modern+life'}, {'title': 'Mystery', 'url': 'https://novelfullplus.com/genres/mystery'}, {'title': 'Psychological', 'url': 'https://novelfullplus.com/genres/psychological'}, {'title': 'Romance', 'url': 'https://novelfullplus.com/genres/romance'}, {'title': 'School life', 'url': 'https://novelfullplus.com/genres/school+life'}, {'title': 'Sci-fi', 'url': 'https://novelfullplus.com/genres/sci-fi'}, {'title': 'Seinen', 'url': 'https://novelfullplus.com/genres/seinen'}, {'title': 'Shoujo', 'url': 'https://novelfullplus.com/genres/shoujo'}, {'title': 'Shoujo Ai', 'url': 'https://novelfullplus.com/genres/shoujo+ai'}, {'title': 'Shounen', 'url': 'https://novelfullplus.com/genres/shounen'}, {'title': 'Shounen Ai', 'url': 'https://novelfullplus.com/genres/shounen+ai'}, {'title': 'Slice of Life', 'url': 'https://novelfullplus.com/genres/slice+of+life'}, {'title': 'Smut', 'url': 'https://novelfullplus.com/genres/smut'}, {'title': 'Options', 'url': ' https://novelfullplus.com/ajax/search?q=hero/javascript:void(0)'}, {'title': 'Contact', 'url': 'https://novelfullplus.com/contact/'}, {'title': 'ToS', 'url': 'https://novelfullplus.com/privacy-policy/'}, {'title': 'Sitemap', 'url': 'https://novelfullplus.com/sitemap-index.xml'}, {'title': '', 'url': ' https://novelfullplus.com/ajax/search?q=hero/#'}]
2021-07-28 20:47:28,423 [INFO] (lncrawl.core.novel_search)
47 results from https://novelfullplus.com/
2021-07-28 20:47:28,465 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): readlightnovels.net:443
2021-07-28 20:47:28,573 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Father of American Comics Superheroes', 'url': 'https://www.novelhunters.com/novel/the-father-of-american-comics-superheroes/', 'info': 'Chapter 66: | Rating: 3.7'}, {'title': 'One Piece Saura', 'url': 'https://www.novelhunters.com/novel/one-piece-saura/', 'info': 'One Piece Shura Chapter 2 - | Rating: 0'}, {'title': 'Emperor of Taikoo', 'url': 'https://www.novelhunters.com/novel/emperor-of-taikoo/', 'info': 'Chapter 69: | Rating: 4'}, {'title': 'Blade of the Sword Master', 'url': 'https://www.novelhunters.com/novel/blade-of-the-sword-master/', 'info': 'Chapter 230: | Rating: 3.8'}]
2021-07-28 20:47:28,580 [INFO] (lncrawl.core.novel_search)
4 results from https://www.novelhunters.com/
2021-07-28 20:47:28,616 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): readnovelfull.com:443
2021-07-28 20:47:28,766 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Hero Returns', 'url': 'https://lightnovel.tv/novel/the-hero-returns/', 'info': 'Chapter 317 | Rating: 0'}, {'title': 'Heroes of Marvel', 'url': 'https://lightnovel.tv/novel/heroes-of-marvel/', 'info': 'Chapter 612 Mutant War 2 | Rating: 0'}, {'title': 'I Was Kicked out of the Hero’s Party Because I Wasn’t a True Companion so I Decided to Have a Slow Life at the Frontier', 'url': 'https://lightnovel.tv/novel/i-was-kicked-out-of-the-heros-party-because-i-wasnt-a-true-companion-so-i-decided-to-have-a-slow-life-at-the-frontier/', 'info': 'Chapter 163 - Gideon’s answer | Rating: 0'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://lightnovel.tv/novel/shift-the-side-character-heroine/', 'info': 'Chapter 773 (END) - The Eternal Heroine (Grand Finale) | Rating: 0'}, {'title': 'The Queen of Everything', 'url': 'https://lightnovel.tv/novel/the-queen-of-everything/', 'info': 'Different Thoughts - Different Thoughts | Rating: 0'}, {'title': 'God Emperor', 'url': 'https://lightnovel.tv/novel/god-emperor/', 'info': 'Chapter 1963 - Meritorious Armor of Flowing Light | Rating: 0'}, {'title': 'The Legend of Futian', 'url': 'https://lightnovel.tv/novel/the-legend-of-futian/', 'info': 'Chapter 2130 - Alchemy Grandmaster | Rating: 0'}, {'title': 'Godly Stay-Home Dad', 'url': 'https://lightnovel.tv/novel/godly-stay-home-dad/', 'info': 'Chapter 920 - A Duel Between Martial Artists | Rating: 0'}, {'title': 'Endless Path : Infinite Cosmos', 'url': 'https://lightnovel.tv/novel/endless-path-infinite-cosmos/', 'info': 'Chapter 2079: The Peculiarities of Demons | Rating: 0'}, {'title': 'Medical Master', 'url': 'https://lightnovel.tv/novel/medical-master/', 'info': 'Chapter 775 - One Was Happy, the Other Was Worried! | Rating: 0'}, {'title': 'Immortal and Martial Dual Cultivation', 'url': 'https://lightnovel.tv/novel/immortal-and-martial-dual-cultivation/', 'info': '\u200bChapter 866: You Are Not Allowed to Die, nor Will You Die | Rating: 0'}, {'title': 'Tsuki ga Michibiku Isekai Douchuu', 'url': 'https://lightnovel.tv/novel/tsuki-ga-michibiku-isekai-douchuu/', 'info': '\u200bExtra 49: Tsige Episode ~ The little sister that had no family and was drunk in blood | Rating: 0'}, {'title': 'The Sword Dynasty', 'url': 'https://lightnovel.tv/novel/the-sword-dynasty/', 'info': 'Voume 4 Chapter 40 - Learn and Teach | Rating: 0'}, {'title': 'Heaven’s Devourer', 'url': 'https://lightnovel.tv/novel/heavens-devourer/', 'info': 'Chapter 1473: Six Great Heavenly Rules | Rating: 0'}, {'title': 'The First Order', 'url': 'https://lightnovel.tv/novel/the-first-order/', 'info': 'Chapter 770 - Mt. Zhuolu | Rating: 0'}, {'title': 'Martial Peak', 'url': 'https://lightnovel.tv/novel/martial-peak/', 'info': 'Chapter 1911 - Laughing at Your Ignorance | Rating: 0'}, {'title': 'Martial God Asura', 'url': 'https://lightnovel.tv/novel/martial-god-asura/', 'info': 'Chapter 4729: Assassination | Rating: 0'}, {'title': 'TranXending Vision', 'url': 'https://lightnovel.tv/novel/tranxending-vision/', 'info': 'Dirty Bastard | Rating: 0'}, {'title': 'Forty Millenniums of Cultivation', 'url': 'https://lightnovel.tv/novel/forty-millenniums-of-cultivation/', 'info': 'Chapter 2634 - I Have Never Heard Such a Request Before! | Rating: 0'}, {'title': 'Worlds’ Apocalypse Online', 'url': 'https://lightnovel.tv/novel/worlds-apocalypse-online/', 'info': 'Chapter 1271 - Gu Qing Shan’s battle | Rating: 0'}, {'title': 'The Divine Physician’s Overbearing Wife', 'url': 'https://lightnovel.tv/novel/the-divine-physicians-overbearing-wife/', 'info': 'Chapter 2098 - The Past Life 23 | Rating: 0'}]
2021-07-28 20:47:28,767 [INFO] (lncrawl.core.novel_search)
21 results from https://lightnovel.tv/
2021-07-28 20:47:28,795 [DEBUG] (urllib3.connectionpool)
https://toc.qidianunderground.org:443 "GET /api/v1/pages/public HTTP/1.1" 200 23024
2021-07-28 20:47:28,804 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): readnovelz.net:443
2021-07-28 20:47:28,953 [DEBUG] (urllib3.connectionpool)
https://www.readlightnovel.cc:443 "GET /search/hero/1 HTTP/1.1" 200 33703
2021-07-28 20:47:28,973 [DEBUG] (lncrawl.core.novel_search)
[{'title': "Titania: The Werewolves' Hero", 'url': 'https://www.novelupdates.cc/Titania:-The-Werewolves--Hero/', 'info': 'Romantic | Rating: 8.0'}, {'title': 'Psycho Hero', 'url': 'https://www.novelupdates.cc/Psycho-Hero/', 'info': 'Fantasy | Rating: 8.0'}, {'title': 'Vengeful Hero', 'url': 'https://www.novelupdates.cc/Vengeful-Hero/', 'info': 'Romantic | Rating: 8.0'}, {'title': 'Heroes of Horizon', 'url': 'https://www.novelupdates.cc/Heroes-of-Horizon/', 'info': 'Fantasy | Rating: 8.0'}, {'title': 'Title of True God', 'url': 'https://www.novelupdates.cc/Title-of-True-God/', 'info': 'Fantasy | Rating: 8.0'}, {'title': 'The highschool hero', 'url': 'https://www.novelupdates.cc/The-highschool-hero/', 'info': 'Romantic | Rating: 8.0'}, {'title': 'Grave of Heroes', 'url': 'https://www.novelupdates.cc/Grave-of-Heroes/', 'info': 'Fantasy | Rating: 8.0'}, {'title': "The Legendary Hero's Brother", 'url': 'https://www.novelupdates.cc/The-Legendary-Hero-s-Brother/', 'info': 'Xianxia | Rating: 8.0'}, {'title': 'Devil Blade, The Rank 7, Class A Hero!', 'url': 'https://www.novelupdates.cc/Devil-Blade,-The-Rank-7,-Class-A-Hero!/', 'info': 'Fantasy | Rating: 8.0'}, {'title': 'Hero of The World', 'url': 'https://www.novelupdates.cc/Hero-of-The-World/', 'info': 'Fantasy | Rating: 8.0'}]
2021-07-28 20:47:28,981 [INFO] (lncrawl.core.novel_search)
10 results from https://www.novelupdates.cc/
2021-07-28 20:47:29,054 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): readwebnovels.net:443
2021-07-28 20:47:29,150 [DEBUG] (urllib3.connectionpool)
https://readnovelfull.com:443 "GET /search?keyword=hero HTTP/1.1" 200 None
2021-07-28 20:47:29,292 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Max Level Hero has Returned!', 'url': 'https://morenovel.net/novel/the-max-level-hero-has-returned/', 'info': 'Chapter 40 | Rating: 5'}, {'title': 'Not All Heroes From Earth Are Bad', 'url': 'https://morenovel.net/novel/not-all-heroes-from-earth-are-bad/', 'info': 'Chapter 35 | Rating: 4'}, {'title': 'The Mightiest Hero of Black ~My Party Members Betrayed Me so I’ll Stick With The Strongest Monster~', 'url': 'https://morenovel.net/novel/the-mightiest-hero-of-black-my-party-members-betrayed-me-so-ill-stick-with-the-strongest-monster/', 'info': 'Chapter 23 | Rating: 4'}, {'title': 'Hero without Blood or Tear', 'url': 'https://morenovel.net/novel/hero-without-blood-or-tear/', 'info': 'Chapter 75 | Rating: 4.7'}, {'title': 'I Was Caught up in a Hero Summoning, but That World Is at Peace', 'url': 'https://morenovel.net/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/', 'info': 'Chapter 766 | Rating: 5'}, {'title': 'Running Away From The Hero! (Remake)', 'url': 'https://morenovel.net/novel/running-away-from-the-hero-remake/', 'info': 'Chapter 133.2 | Rating: 4'}, {'title': 'Kill the Hero', 'url': 'https://morenovel.net/novel/kill-the-hero/', 'info': 'Chapter 275 - END | Rating: 4.5'}, {'title': 'The Hero Returns', 'url': 'https://morenovel.net/novel/the-hero-returns/', 'info': 'Chapter 380 | Rating: 4.7'}, {'title': 'FFF-Class Trashero', 'url': 'https://morenovel.net/novel/fff-class-trashero/', 'info': 'Chapter 110 | Rating: 4.5'}, {'title': 'Ending Maker', 'url': 'https://morenovel.net/novel/ending-maker/', 'info': 'Chapter 135 | Rating: 5'}, {'title': 'Genjitsushugi Yuusha no Oukoku Saikenki', 'url': 'https://morenovel.net/novel/genjitsushugi-yuusha-no-oukoku-saikenki/', 'info': 'Vol. 4 - 6.3 | Rating: 4'}, {'title': 'Yuusha ni Horobosareru', 'url': 'https://morenovel.net/novel/yuusha-ni-horobosareru/', 'info': 'Vol. 10 - 21.4 - END | Rating: 4.7'}]
2021-07-28 20:47:29,296 [INFO] (lncrawl.core.novel_search)
12 results from https://morenovel.net/
2021-07-28 20:47:29,401 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.readwn.com:443
2021-07-28 20:47:29,536 [DEBUG] (urllib3.connectionpool)
https://readlightnovels.net:443 "GET /?s=hero HTTP/1.1" 200 None
2021-07-28 20:47:29,605 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'You Treat Me As If I Have A Sickness', 'url': 'https://www.novelmultiverse.com/novel/you-treat-me-as-if-i-have-a-sickness/', 'info': 'Chapter 10 | Rating: 5'}, {'title': 'A young girl in a village without protection', 'url': 'https://www.novelmultiverse.com/novel/a-young-girl-in-a-village-without-protection/', 'info': 'Chapter 85 | Rating: 4.5'}, {'title': 'Reiko’s Manners – She’s Referred To As A Villainess, But Actually She’s Just Penniless', 'url': 'https://www.novelmultiverse.com/novel/reikos-manners-shes-referred-to-as-a-villainess-but-actually-shes-just-penniless/', 'info': 'Chapter 6 | Rating: 4.6'}, {'title': 'Auto Assigned Villainess', 'url': 'https://www.novelmultiverse.com/novel/auto-assigned-villainess/', 'info': 'Chapter 50 | Rating: 4.5'}, {'title': 'I Don’t Care About the Story, I Want a Cat ~Transmigrated into an Otome Game~', 'url': 'https://www.novelmultiverse.com/novel/i-dont-care-about-the-story-i-want-a-cat-%ef%bd%9etransmigrated-into-an-otome-game%ef%bd%9e/', 'info': 'Chapter 23 | Rating: 4.3'}, {'title': 'Reincarnated Young Lady Aims to Be an Adventurer', 'url': 'https://www.novelmultiverse.com/novel/reincarnated-young-lady-aims-to-be-an-adventurer/', 'info': 'Volume 9 Chapter 171 | Rating: 4.7'}]
2021-07-28 20:47:29,611 [INFO] (lncrawl.core.novel_search)
6 results from https://www.novelmultiverse.com/
2021-07-28 20:47:29,652 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.royalroad.com:443
2021-07-28 20:47:29,823 [DEBUG] (urllib3.connectionpool)
https://omgnovels.com:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:30,036 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Deity Hero: Me! Gaining Disciples Makes Me Stronger!', 'url': 'https://boxnovel.com/novel/deity-hero-me-gaining-disciples-makes-me-stronger/', 'info': 'Chapter 191 | Rating: 3.9'}, {'title': 'God Emperor', 'url': 'https://boxnovel.com/novel/god-emperor/', 'info': 'Chapter 2055 | Rating: 4.2'}, {'title': 'Rebirth: Divine Doctor, Sweet Wife', 'url': 'https://boxnovel.com/novel/rebirth-divine-doctor-sweet-wife/', 'info': 'Chapter 645 | Rating: 4.5'}, {'title': 'The Queen of Everything', 'url': 'https://boxnovel.com/novel/the-queen-of-everything/', 'info': 'Chapter 942 | Rating: 4.4'}, {'title': 'Rebirth Of The Apocalypse Queen: On Your Knees, Young Emperor!', 'url': 'https://boxnovel.com/novel/rebirth-o-f-the-apocalypse-queen-on-your-knees-young-emperor/', 'info': 'Chapter 609 | Rating: 4.5'}, {'title': 'The Legend of Futian', 'url': 'https://boxnovel.com/novel/the-legend-of-futian/', 'info': 'Chapter 2314 | Rating: 4.2'}, {'title': 'Medical Master', 'url': 'https://boxnovel.com/novel/medical-master/', 'info': 'Chapter 827 | Rating: 4.2'}, {'title': 'Plague Doctor', 'url': 'https://boxnovel.com/novel/plague-doctor/', 'info': 'Chapter 478 | Rating: 4.3'}, {'title': 'Immortal Hero: I Can See the Success Rate', 'url': 'https://boxnovel.com/novel/immortal-hero-i-can-see-the-success-rate/', 'info': 'Chapter 121 | Rating: 3.7'}, {'title': 'Arifureta Shokugyou de Sekai Saikyou (WN)', 'url': 'https://boxnovel.com/novel/arifureta-shokugyou-de-sekai-saikyou-wn/', 'info': 'Chapter 407 | Rating: 4.4'}, {'title': 'My Dungeons Are Popular', 'url': 'https://boxnovel.com/novel/my-dungeons-are-popular/', 'info': 'Chapter 91 | Rating: 4.2'}, {'title': 'My Fusion System: Fusing a Thousand Chickens at the Start', 'url': 'https://boxnovel.com/novel/my-fusion-system-fusing-a-thousand-chickens-at-the-start/', 'info': 'Chapter 200 | Rating: 4'}, {'title': 'Binding to Geniuses To Become Stronger', 'url': 'https://boxnovel.com/novel/binding-to-geniuses-to-become-stronger/', 'info': 'Chapter 161 | Rating: 4.3'}, {'title': 'Starting With 3 S-Class Talents', 'url': 'https://boxnovel.com/novel/starting-with-3-s-class-talents/', 'info': 'Chapter 193 | Rating: 3.7'}, {'title': 'I Experienced an SSS Encryption', 'url': 'https://boxnovel.com/novel/i-experienced-an-sss-encryption/', 'info': 'Chapter 132 (END) | Rating: 4.1'}, {'title': 'Pet Beasts of the World: Hundred-Fold Multiplier System', 'url': 'https://boxnovel.com/novel/pet-beasts-of-the-world-hundred-fold-multiplier-system/', 'info': 'Chapter 181 | Rating: 3.6'}, {'title': 'Midnight Bookstore', 'url': 'https://boxnovel.com/novel/midnight-bookstore/', 'info': 'Chapter 435 | Rating: 3.6'}, {'title': 'Supreme Crazy Wife', 'url': 'https://boxnovel.com/novel/supreme-crazy-wife/', 'info': 'Chapter 221 | Rating: 4.4'}, {'title': 'I Really Am Not The Lord of Demon', 'url': 'https://boxnovel.com/novel/i-really-am-not-the-lord-of-demon/', 'info': 'Chapter 378 | Rating: 4.1'}, {'title': 'My Sister the Heroine, and I the Villainess', 'url': 'https://boxnovel.com/novel/my-sister-the-heroine-and-i-the-villainess/', 'info': 'Chapter 115 | Rating: 4.3'}, {'title': 'Heroes of Marvel', 'url': 'https://boxnovel.com/novel/heroes-of-marvel/', 'info': 'Chapter 386 | Rating: 4.2'}]
2021-07-28 20:47:30,037 [INFO] (lncrawl.core.novel_search)
21 results from https://boxnovel.com/
2021-07-28 20:47:30,068 [DEBUG] (lncrawl.sources.scribblehub)
Visiting https://www.scribblehub.com/?s=hero&post_type=fictionposts
2021-07-28 20:47:30,077 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.scribblehub.com:443
2021-07-28 20:47:30,262 [DEBUG] (urllib3.connectionpool)
https://www.royalroad.com:443 "GET /fictions/search?keyword=hero HTTP/1.1" 200 None
2021-07-28 20:47:30,275 [DEBUG] (lncrawl.core.novel_search)
[{'title': "Titania: The Werewolves' Hero", 'url': 'https://www.readlightnovel.cc/Titania:-The-Werewolves--Hero/', 'info': 'Erza18 '}, {'title': 'Golden Hero', 'url': 'https://www.readlightnovel.cc/Golden-Hero/', 'info': 'Julian69 '}, {'title': 'Devil Blade, The Rank 7, Class A Hero!', 'url': 'https://www.readlightnovel.cc/Devil-Blade,-The-Rank-7,-Class-A-Hero!/', 'info': 'JexRekk '}, {'title': 'Grave of Heroes', 'url': 'https://www.readlightnovel.cc/Grave-of-Heroes/', 'info': 'Andrew Reise '}, {'title': 'Heroes of Horizon', 'url': 'https://www.readlightnovel.cc/Heroes-of-Horizon/', 'info': 'Lynx_73 '}, {'title': "A Hero's Journey", 'url': 'https://www.readlightnovel.cc/A-Hero-s-Journey/', 'info': 'SlyOW '}, {'title': 'Vengeful Hero', 'url': 'https://www.readlightnovel.cc/Vengeful-Hero/', 'info': 'bababkchod '}, {'title': 'Psycho Hero', 'url': 'https://www.readlightnovel.cc/Psycho-Hero/', 'info': 'LuckGod '}, {'title': 'My Second Life is a Heroic Power Fantasy', 'url': 'https://www.readlightnovel.cc/My-Second-Life-is-a-Heroic-Power-Fantasy/', 'info': 'Clowniac '}, {'title': "The Legendary Hero's Brother", 'url': 'https://www.readlightnovel.cc/The-Legendary-Hero-s-Brother/', 'info': 'blairehawthorne '}]
2021-07-28 20:47:30,298 [INFO] (lncrawl.core.novel_search)
10 results from https://www.readlightnovel.cc/
2021-07-28 20:47:30,354 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): skynovel.org:443
2021-07-28 20:47:30,437 [DEBUG] (urllib3.connectionpool)
https://www.readwn.com:443 "GET /search.html HTTP/1.1" 200 None
2021-07-28 20:47:30,991 [DEBUG] (urllib3.connectionpool)
https://www.scribblehub.com:443 "GET /?s=hero&post_type=fictionposts HTTP/1.1" 200 None
2021-07-28 20:47:31,143 [DEBUG] (lncrawl.core.novel_search)
[{'url': 'https://readnovelfull.com/the-hero-returns.html', 'title': 'The Hero Returns', 'info': 'last chapter : Chapter 383'}, {'url': 'https://readnovelfull.com/heroes-of-marvel.html', 'title': 'Heroes of Marvel', 'info': 'last chapter : CHAPTER 667 VISI'}, {'url': 'https://readnovelfull.com/nidome-no-yuusha.html', 'title': 'Nidome no Yuusha', 'info': 'last chapter : Chapter 202: A forcible end to the stalemate [Continuation]'}, {'url': 'https://readnovelfull.com/my-sister-the-heroine-and-i-the-villainess.html', 'title': 'My Sister the Heroine, and I the Villainess', 'info': 'last chapter : Chapter 115'}, {'url': 'https://readnovelfull.com/i-was-kicked-out-of-the-heros-party-because-i-wasnt-a-true-companion-so-i-decided-to-have-a-slow-life-at-the-frontier.html', 'title': "I Was Kicked out of the Hero's Party Because I Wasn't a True Companion so I Decided to Have a Slow Life at the Frontier", 'info': 'last chapter : Chapter 163 - Gideon’s answer'}]
2021-07-28 20:47:31,154 [INFO] (lncrawl.core.novel_search)
5 results from https://readnovelfull.com/
2021-07-28 20:47:31,198 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): supernovel.net:443
2021-07-28 20:47:31,304 [DEBUG] (urllib3.connectionpool)
https://skynovel.org:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:31,373 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Deity Hero: Me! Gaining Disciples Makes Me Stronger!', 'url': 'https://toc.qidianunderground.org/api/v1/pages/public/d4d8beb31fd2c6e6/chapters', 'info': 'Last Updated: 2021-07-28 02:05:00 PM', 'score': 5}, {'title': 'Immortal Hero: I Can See the Success Rate', 'url': 'https://toc.qidianunderground.org/api/v1/pages/public/788235be592ee1ee/chapters', 'info': 'Last Updated: 2021-07-27 03:16:36 AM', 'score': 5}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://toc.qidianunderground.org/api/v1/pages/public/80d6bbaa30369456/chapters', 'info': 'Last Updated: 2020-06-12 03:20:28 PM', 'score': 5}, {'title': 'The Hero Returns', 'url': 'https://toc.qidianunderground.org/api/v1/pages/public/fbad71994e874006/chapters', 'info': 'Last Updated: 2021-07-28 04:06:03 PM', 'score': 5}, {'title': 'Alchemy Emperor of the Divine Dao', 'url': 'https://toc.qidianunderground.org/api/v1/pages/public/eba695c266fdf164/chapters', 'info': 'Last Updated: 2021-07-24 02:34:44 AM', 'score': 4}, {'title': 'Ancient Fiend Dragon Emperor', 'url': 'https://toc.qidianunderground.org/api/v1/pages/public/d86c3aab324e88c6/chapters', 'info': 'Last Updated: 2020-08-08 05:57:17 AM', 'score': 4}, {'title': 'Another World’s Versatile Crafting Master', 'url': 'https://toc.qidianunderground.org/api/v1/pages/public/f1a4e5e165a31d34/chapters', 'info': 'Last Updated: 2021-07-24 02:38:40 AM', 'score': 4}, {'title': 'Big Shot Little Jiaojiao Breaks Her Persona Again', 'url': 'https://toc.qidianunderground.org/api/v1/pages/public/48fb691b19d7e951/chapters', 'info': 'Last Updated: 2021-07-27 03:16:13 AM', 'score': 4}, {'title': 'Dangerous Fiancee', 'url': 'https://toc.qidianunderground.org/api/v1/pages/public/5f3cc3cb01d08783/chapters', 'info': 'Last Updated: 2020-06-12 03:18:15 PM', 'score': 4}, {'title': 'Dragon Emperor, Martial God', 'url': 'https://toc.qidianunderground.org/api/v1/pages/public/a916e3df7094b28a/chapters', 'info': 'Last Updated: 2020-05-12 11:07:51 AM', 'score': 4}]
2021-07-28 20:47:31,384 [INFO] (lncrawl.core.novel_search)
10 results from https://toc.qidianunderground.org/
2021-07-28 20:47:31,464 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): tunovelaligera.com:443
2021-07-28 20:47:31,572 [DEBUG] (lncrawl.core.crawler)
POST url=https://www.readwn.com/e/search/index.php, data={'show': 'title', 'tempid': '1', 'tbname': 'news', 'keyboard': 'hero'}, headers={'referer': 'https://www.readwn.com/search.html', 'origin': 'https://www.readwn.com', 'content-type': 'application/x-www-form-urlencoded'}
2021-07-28 20:47:31,965 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'History’s Strongest Shopkeeper', 'url': 'https://omgnovels.com/novel/historys-strongest-shopkeeper/', 'info': 'Chapter 1812 - The Boundary Of Zhouyang Forever Ten Thousand Jielou( Big Result) | Rating: 3.5'}, {'title': 'Omnipotent Wuxia System', 'url': 'https://omgnovels.com/novel/omnipotent-wuxia-system/', 'info': 'Chapter 708 - Flies Upwards The (Last Part) Big Result | Rating: 3.3'}, {'title': 'Strongest Villain System', 'url': 'https://omgnovels.com/novel/strongest-villain-system/', 'info': 'Chapter 700 - Quest Goal | Rating: 2.9'}]
2021-07-28 20:47:31,966 [INFO] (lncrawl.core.novel_search)
3 results from https://omgnovels.com/
2021-07-28 20:47:31,991 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Hero Returns', 'url': 'https://readlightnovels.net/the-hero-returns.html', 'info': 'Latest chapter: Chapter 383'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://readlightnovels.net/shift-the-side-character-heroine.html', 'info': 'Latest chapter: Chapter 764 (END) - A Laughing Stock?'}, {'title': 'Running Away From The Hero! (Remake)', 'url': 'https://readlightnovels.net/running-away-from-the-hero-remake.html', 'info': 'Latest chapter: Chapter 120'}, {'title': 'My Sister the Heroine, and I the Villainess', 'url': 'https://readlightnovels.net/my-sister-the-heroine-and-i-the-villainess.html', 'info': 'Latest chapter: Chapter 115'}, {'title': 'My Hero', 'url': 'https://readlightnovels.net/my-hero.html', 'info': 'Latest chapter: short story (END)'}, {'title': 'I Was Kicked out of the Hero’s Party Because I Wasn’t a True Companion so I Decided to Have a Slow Life at the Frontier', 'url': 'https://readlightnovels.net/i-was-kicked-out-of-the-heros-party-because-i-wasnt-a-true-companion-so-i-decided-to-have-a-slow-life-at-the-frontier.html', 'info': 'Latest chapter: Chapter 163 - Gideon’s answer'}, {'title': 'Heroes of Marvel', 'url': 'https://readlightnovels.net/heroes-of-marvel.html', 'info': 'Latest chapter: Chapter 386 - WAKING UP'}, {'title': 'FFF-Class Trashero Novel', 'url': 'https://readlightnovels.net/fff-class-trashero.html', 'info': 'Latest chapter: Chapter 111'}, {'title': 'Sendai Yuusha wa Inkyou Shitai Novel (The Previous Hero wants to Retire Novel)', 'url': 'https://readlightnovels.net/sendai-yuusha-wa-inkyou-shitai.html', 'info': 'Latest chapter: Chapter 152 – The Preceding Hero and the Witch of Time'}, {'title': 'Heroes Shed No Tears', 'url': 'https://readlightnovels.net/heroes-shed-no-tears.html', 'info': 'Latest chapter: Chapter 18'}, {'title': 'Tate No Yuusha No Nariagari Novel (WN) - The Rising Of The Shield Hero Novel (WN)', 'url': 'https://readlightnovels.net/tate-no-yuusha-no-nariagari-wn.html', 'info': 'Latest chapter: Chapter 388'}, {'title': 'Tate No Yuusha No Nariagari Light Novel (The Rising Of The Shield Hero Light Novel)', 'url': 'https://readlightnovels.net/tate-no-yuusha-no-nariagari-ln.html', 'info': 'Latest chapter: Ep'}, {'title': "Hero? I've Long Stopped Being One", 'url': 'https://readlightnovels.net/hero-ive-long-stopped-being-one.html', 'info': 'Latest chapter: Volume 1 Chapter 3'}, {'title': 'The Laid-back Life in Another World of the Ex-Hero Candidate Who Turned out to be a Cheat from Level 2', 'url': 'https://readlightnovels.net/the-laid-back-life-in-another-world-of-the-ex-hero-candidate-who-turned-out-to-be-a-cheat-from-level-2.html', 'info': 'Latest chapter: Chapter 103'}, {'title': 'Seoul Station’s Necromancer Novel', 'url': 'https://readlightnovels.net/seoul-stations-necromancer-novel-id1.html', 'info': 'Latest chapter: No chapter'}, {'title': 'World Development System Novel', 'url': 'https://readlightnovels.net/world-development-system-novel-id1.html', 'info': 'Latest chapter: No chapter'}, {'title': 'The Legendary Mechanic Novel', 'url': 'https://readlightnovels.net/the-legendary-mechanic-novel-id1.html', 'info': 'Latest chapter: No chapter'}, {'title': 'Death Is The Only Ending For The Villain', 'url': 'https://readlightnovels.net/death-is-the-only-ending-for-the-villain.html', 'info': 'Latest chapter: Chapter ss-30'}, {'title': 'The Law of Webnovels', 'url': 'https://readlightnovels.net/the-law-of-webnovels.html', 'info': 'Latest chapter: Chapter 327'}, {'title': 'A Step into the Past', 'url': 'https://readlightnovels.net/a-step-into-the-past.html', 'info': 'Latest chapter: Volume 25 Epilogue'}]
2021-07-28 20:47:32,029 [INFO] (lncrawl.core.novel_search)
20 results from https://readlightnovels.net/
2021-07-28 20:47:32,034 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): viewnovel.net:443
2021-07-28 20:47:32,123 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): vipnovel.com:443
2021-07-28 20:47:32,135 [DEBUG] (urllib3.connectionpool)
https://www.readwn.com:443 "POST /e/search/index.php HTTP/1.1" 302 None
2021-07-28 20:47:32,219 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Deity Hero: Me! Gaining Disciples Makes Me Stronger!', 'url': 'https://listnovel.com/novel/deity-hero-me-gaining-disciples-makes-me-stronger/', 'info': 'Chapter 191 | Rating: 4.7'}, {'title': 'Immortal Hero: I Can Replicate Talents', 'url': 'https://listnovel.com/novel/immortal-hero-i-can-replicate-talents/', 'info': 'Chapter 44 | Rating: 4.2'}, {'title': 'Immortal Hero: I Can See the Success Rate', 'url': 'https://listnovel.com/novel/immortal-hero-i-can-see-the-success-rate/', 'info': 'Chapter 121 | Rating: 3.7'}, {'title': 'The Hero Returns Novel', 'url': 'https://listnovel.com/novel/the-hero-returns-freenovel-read/', 'info': 'Chapter 383 | Rating: 4.6'}, {'title': 'Treacherous Living in the Imperial Harem', 'url': 'https://listnovel.com/novel/treacherous-living-in-the-imperial-harem/', 'info': 'Chapter 120 | Rating: 4.4'}, {'title': 'Heroine Saves A Gentleman', 'url': 'https://listnovel.com/novel/heroine-saves-a-gentleman/', 'info': 'Chapter 152 | Rating: 4.7'}, {'title': 'Heroic Wife Reborn', 'url': 'https://listnovel.com/novel/heroic-wife-reborn/', 'info': 'Chapter 154 | Rating: 4.1'}, {'title': 'The Return of the Condor Heroes', 'url': 'https://listnovel.com/novel/the-return-of-the-condor-heroes/', 'info': 'Chapter 465 | Rating: 4.5'}, {'title': 'The Coming Heroine: The Only Princess', 'url': 'https://listnovel.com/novel/the-coming-heroine-the-only-princess/', 'info': 'Chapter 268 | Rating: 4'}, {'title': 'FFF-Class Trashero', 'url': 'https://listnovel.com/novel/fff-class-trashero/', 'info': 'Chapter 115 | Rating: 3.7'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://listnovel.com/novel/shift-the-side-character-heroine/', 'info': 'Chapter 773 | Rating: 4.5'}, {'title': 'My Hero', 'url': 'https://listnovel.com/novel/my-hero/', 'info': ' Short story (END) | Rating: 2'}, {'title': 'My Dungeons Are Popular', 'url': 'https://listnovel.com/novel/my-dungeons-are-popular/', 'info': 'Chapter 91 | Rating: 5'}, {'title': 'My Fusion System: Fusing a Thousand Chickens at the Start', 'url': 'https://listnovel.com/novel/my-fusion-system-fusing-a-thousand-chickens-at-the-start/', 'info': 'Chapter 200 | Rating: 4.7'}, {'title': 'Starting With 3 S-Class Talents', 'url': 'https://listnovel.com/novel/starting-with-3-s-class-talents/', 'info': 'Chapter 193 | Rating: 5'}, {'title': 'Pet Beasts of the World: Hundred-Fold Multiplier System', 'url': 'https://listnovel.com/novel/pet-beasts-of-the-world-hundred-fold-multiplier-system/', 'info': 'Chapter 181 | Rating: 4.5'}, {'title': 'Binding to Geniuses To Become Stronger', 'url': 'https://listnovel.com/novel/binding-to-geniuses-to-become-stronger/', 'info': 'Chapter 161 | Rating: 5'}, {'title': 'Supreme Crazy Wife', 'url': 'https://listnovel.com/novel/supreme-crazy-wife/', 'info': 'Chapter 221 | Rating: 4.7'}, {'title': 'I Experienced an SSS Encryption Novel', 'url': 'https://listnovel.com/novel/i-experienced-an-sss-encryption-novel/', 'info': 'Chapter 132_END | Rating: 4'}, {'title': 'God Rank Upgrade System', 'url': 'https://listnovel.com/novel/god-rank-upgrade-system/', 'info': 'Chapter 227 | Rating: 3.7'}, {'title': 'The Genius Doctor, My Wife, Is Valiant', 'url': 'https://listnovel.com/novel/the-genius-doctor-my-wife-is-valiant/', 'info': 'Chapter 248 | Rating: 4.3'}, {'title': 'Omae Mitai na Hiroin ga Ite Tamaruka!', 'url': 'https://listnovel.com/novel/omae-mitai-na-hiroin-ga-ite-tamaruka/', 'info': 'Chapter 23 | Rating: 3'}]
2021-07-28 20:47:32,220 [INFO] (lncrawl.core.novel_search)
22 results from https://listnovel.com/
2021-07-28 20:47:32,259 [INFO] (lncrawl.sources.volarenovels)
Visiting https://www.volarenovels.com/api/novels/search?query=hero&count=5 ...
2021-07-28 20:47:32,262 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.volarenovels.com:443
2021-07-28 20:47:32,283 [DEBUG] (urllib3.connectionpool)
https://readwebnovels.net:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:32,563 [DEBUG] (urllib3.connectionpool)
https://tunovelaligera.com:443 "GET /?s=hero&post_type=wp-manga HTTP/1.1" 200 None
2021-07-28 20:47:32,689 [DEBUG] (urllib3.connectionpool)
https://supernovel.net:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:32,796 [DEBUG] (root)
Searching failure for https://viewnovel.net/
2021-07-28 20:47:32,856 [DEBUG] (urllib3.connectionpool)
https://www.readwn.com:443 "GET /e/search/result/?searchid=1346 HTTP/1.1" 200 None
2021-07-28 20:47:32,871 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): wbnovel.com:443
2021-07-28 20:47:33,051 [DEBUG] (urllib3.connectionpool)
https://readnovelz.net:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:33,400 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Invincible Hero', 'url': 'https://novel27.com/novel/the-invincible-hero/', 'info': 'Chapter 112 | Rating: 0'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://novel27.com/novel/shift-the-side-character-heroine/', 'info': 'Chapter 764 | Rating: 0'}, {'title': 'Jurassic Hero (Boku no Hero Academia Fanfic).', 'url': 'https://novel27.com/novel/jurassic-hero-boku-no-hero-academia-fanfic/', 'info': 'Chapter 181 | Rating: 5'}, {'title': 'Edea: Hero Summoning Conspiracy', 'url': 'https://novel27.com/novel/edea-hero-summoning-conspiracy/', 'info': 'Chapter 217 | Rating: 5'}, {'title': 'She Becomes the Hero in Another World', 'url': 'https://novel27.com/novel/she-becomes-the-hero-in-another-world/', 'info': 'Chapter 172 | Rating: 3.5'}, {'title': 'The Demonsong Epic By the Brandon Gould who wrote Chossen Heros of Tylingariea', 'url': 'https://novel27.com/novel/the-demonsong-epic-by-the-brandon-gould-who-wrote-chossen-heros-of-tylingariea/', 'info': 'Chapter 142 | Rating: 1'}, {'title': 'The Demon King’s Hero of Light', 'url': 'https://novel27.com/novel/the-demon-kings-hero-of-light/', 'info': 'Chapter 197 | Rating: 0'}, {'title': 'My Second Life is a Heroic Power Fantasy', 'url': 'https://novel27.com/novel/my-second-life-is-a-heroic-power-fantasy/', 'info': "The Devil's Graduation side-story on WPC 103 | Rating: 5"}, {'title': 'Age of Heroes ( Age of Heroes Chronicles)', 'url': 'https://novel27.com/novel/age-of-heroes-age-of-heroes-chronicles/', 'info': 'Chapter 185 | Rating: 4.5'}, {'title': 'Reincarnated Hero Kills the Summoner', 'url': 'https://novel27.com/novel/reincarnated-hero-kills-the-summoner/', 'info': 'Power Levels , System and Points | Rating: 5'}, {'title': 'Brutal Journey of an Unfortunate Heroine', 'url': 'https://novel27.com/novel/brutal-journey-of-an-unfortunate-heroine/', 'info': 'The World Etafor Windim | Rating: 3'}, {'title': 'My Hero Academia – Saiyaman', 'url': 'https://novel27.com/novel/my-hero-academia-saiyaman/', 'info': 'Chapter 31 | Rating: 0'}, {'title': 'The Hero’s Supplier', 'url': 'https://novel27.com/novel/the-heros-supplier/', 'info': 'Chapter 71 | Rating: 5'}, {'title': 'Unfortunate Hero’s Retirement Life', 'url': 'https://novel27.com/novel/unfortunate-heros-retirement-life/', 'info': 'Class | Rating: 4.7'}, {'title': 'Trash of the Count’s Family (Web Novel)', 'url': 'https://novel27.com/novel/trash-of-the-counts-family-web-novel/', 'info': 'Chapter 652 | Rating: 0'}, {'title': 'I Reincarnated For Nothing', 'url': 'https://novel27.com/novel/i-reincarnated-for-nothing/', 'info': 'Chapter 203 (END) | Rating: 4'}, {'title': 'Soaring the Heavens', 'url': 'https://novel27.com/novel/soaring-the-heavens/', 'info': 'Chapter 532 | Rating: 5'}, {'title': 'Plundering the Heavens', 'url': 'https://novel27.com/novel/plundering-the-heavens/', 'info': 'Chapter 425 | Rating: 5'}, {'title': 'It Seems Like I Got Reincarnated Into The World of a Yandere Otome Game', 'url': 'https://novel27.com/novel/it-seems-like-i-got-reincarnated-into-the-world-of-a-yandere-otome-game/', 'info': 'Chapter 61 (END) | Rating: 0'}, {'title': 'World Reformation Activities of the Dark God — Loving Humans So Much, I Reincarnated in One', 'url': 'https://novel27.com/novel/world-reformation-activities-of-the-dark-god-loving-humans-so-much-i-reincarnated-in-one/', 'info': 'Chapter 423 (END) | Rating: 5'}]
2021-07-28 20:47:33,401 [INFO] (lncrawl.core.novel_search)
20 results from https://novel27.com/
2021-07-28 20:47:33,436 [INFO] (lncrawl.sources.webnovel)
Getting CSRF Token
2021-07-28 20:47:33,451 [DEBUG] (urllib3.connectionpool)
https://wbnovel.com:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:33,456 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): m.webnovel.com:443
2021-07-28 20:47:33,466 [DEBUG] (urllib3.connectionpool)
https://www.volarenovels.com:443 "GET /api/novels/search?query=hero&count=5 HTTP/1.1" 200 None
2021-07-28 20:47:33,488 [DEBUG] (lncrawl.core.novel_search)
[]
2021-07-28 20:47:33,508 [INFO] (lncrawl.core.novel_search)
0 results from https://www.volarenovels.com/
2021-07-28 20:47:33,589 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'I’m Troubled by the Prince’s Love ~Reincarnated Heroine, The Otome Game Struggle~', 'url': 'https://noveltranslate.com/novel/im-troubled-by-the-princes-love-reincarnated-heroine-the-otome-game-struggle/', 'info': 'Chapter 157 | Rating: 1'}, {'title': 'Strategy Hero White Moonlight [Quick Wear]', 'url': 'https://noveltranslate.com/novel/strategy-hero-white-moonlight-quick-wear/', 'info': 'Chapter 42 | Rating: 0'}, {'title': 'Heroine’s Road to Becoming Scum', 'url': 'https://noveltranslate.com/novel/heroines-road-to-becoming-scum/', 'info': 'Chapter 1039 | Rating: 0'}, {'title': 'Senior Green Tea Turned Into an Abused Heroine', 'url': 'https://noveltranslate.com/novel/senior-green-tea-turned-into-an-abused-heroine/', 'info': 'Chapter 60 | Rating: 0'}, {'title': 'The Village Girl Who Was Forced to Become the Hero', 'url': 'https://noveltranslate.com/novel/the-village-girl-who-was-forced-to-become-the-hero/', 'info': 'Chapter 94 | Rating: 0'}, {'title': 'After Becoming the Hero’s Ex-fiancée', 'url': 'https://noveltranslate.com/novel/after-becoming-the-heros-ex-fiancee/', 'info': 'Chapter 183 | Rating: 5'}, {'title': 'The 300 Heroes of the Manga', 'url': 'https://noveltranslate.com/novel/the-300-heroes-of-the-manga/', 'info': 'Chapter 903 | Rating: 5'}, {'title': 'Quick Transmigration: Heroine Arrives, Woman Rapidly Retreats!', 'url': 'https://noveltranslate.com/novel/quick-transmigration-heroine-arrives-woman-rapidly-retreats/', 'info': 'Chapter 2213 | Rating: 5'}, {'title': 'Villain’s Hero Life', 'url': 'https://noveltranslate.com/novel/villains-hero-life/', 'info': 'Chapter 127 | Rating: 3'}, {'title': 'Hero of the Penalty Area', 'url': 'https://noveltranslate.com/novel/hero-of-the-penalty-area/', 'info': 'Chapter 1674 | Rating: 5'}]
2021-07-28 20:47:33,593 [INFO] (lncrawl.core.novel_search)
10 results from https://noveltranslate.com/
2021-07-28 20:47:33,617 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.webnovelover.com:443
2021-07-28 20:47:33,667 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): wondernovels.com:443
2021-07-28 20:47:34,058 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'I Was Kicked out of the Hero’s Party Because I Wasn’t a True Companion so I Decided to Have a Slow Life at the Frontier', 'url': 'https://clicknovel.net/novel/i-was-kicked-out-of-the-heros-party-because-i-wasnt-a-true-companion-so-i-decided-to-have-a-slow-life-at-the-frontier/', 'info': 'Chapter 162 | Rating: 0'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://clicknovel.net/novel/shift-the-side-character-heroine/', 'info': 'Chapter 773 (END) | Rating: 5'}, {'title': 'Heroes of Marvel', 'url': 'https://clicknovel.net/novel/heroes-of-marvel/', 'info': 'Chapter 386 | Rating: 5'}, {'title': 'My Sister the Heroine, and I the Villainess', 'url': 'https://clicknovel.net/novel/my-sister-the-heroine-and-i-the-villainess/', 'info': 'Chapter 115(End) | Rating: 0'}, {'title': 'I Became the Hero’s Bride!', 'url': 'https://clicknovel.net/novel/i-became-the-heros-bride/', 'info': 'Chapter 35(End) | Rating: 0'}, {'title': 'Kill the Hero', 'url': 'https://clicknovel.net/novel/kill-the-hero/', 'info': 'Chapter 115 | Rating: 0'}, {'title': 'Running Away From The Hero! (Remake)', 'url': 'https://clicknovel.net/novel/running-away-from-the-hero-remake/', 'info': 'Chapter 120 | Rating: 0'}, {'title': 'From The Strongest Job of Dragon Knight, To The Beginner Job Carrier, Somehow, The Heroes are Depending on Me', 'url': 'https://clicknovel.net/novel/from-the-strongest-job-of-dragon-knight-to-the-beginner-job-carrier-somehow-the-heroes-are-depending-on-me/', 'info': 'Volume 4 Chapter 17.2 | Rating: 0'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://clicknovel.net/novel/shift-the-side-character-heroine-novel/', 'info': 'Chapter 773 (END) | Rating: 0'}, {'title': 'FFF-Class Trashero', 'url': 'https://clicknovel.net/novel/fff-class-trashero/', 'info': 'Chapter 99 | Rating: 0'}, {'title': 'The Taming of the Ruffian Hero', 'url': 'https://clicknovel.net/novel/the-taming-of-the-ruffian-hero/', 'info': 'Chapter 230 | Rating: 0'}, {'title': 'The Coming Heroine: The Only Princess', 'url': 'https://clicknovel.net/novel/the-coming-heroine-the-only-princess/', 'info': 'Chapter 268 | Rating: 0'}, {'title': 'I Pulled the Sword and Became the Heroine?!', 'url': 'https://clicknovel.net/novel/i-pulled-the-sword-and-became-the-heroine/', 'info': 'Chapter 35 | Rating: 0'}, {'title': 'The Hero Returns', 'url': 'https://clicknovel.net/novel/the-hero-returns/', 'info': 'Chapter 213 | Rating: 5'}, {'title': 'I Was Dismissed from the Hero’s Party Because They Don’t Need My Training Skills, so I Strengthen My [Fief] Which I Got as a Replacement for My Retirement Money.', 'url': 'https://clicknovel.net/novel/i-was-dismissed-from-the-heros-party-because-they-dont-need-my-training-skills-so-i-strengthen-my-fief-which-i-got-as-a-replacement-for-my-retirement-money/', 'info': 'Chapter SS 3 | Rating: 4'}, {'title': 'It’s Easy to Take Care of a Live-in Hero!', 'url': 'https://clicknovel.net/novel/its-easy-to-take-care-of-a-live-in-hero/', 'info': 'Chapter 552 | Rating: 4.5'}, {'title': 'Nurturing the Hero to Avoid Death', 'url': 'https://clicknovel.net/novel/nurturing-the-hero-to-avoid-death/', 'info': 'Chapter 2257 | Rating: 5'}, {'title': 'Quick Transmigration: Heroine Arrives, Woman Rapidly Retreats!', 'url': 'https://clicknovel.net/novel/quick-transmigration-heroine-arrives-woman-rapidly-retreats/', 'info': 'Chapter 382 | Rating: 5'}, {'title': 'The Icy Hero is Yearning for Love', 'url': 'https://clicknovel.net/novel/the-icy-hero-is-yearning-for-love/', 'info': 'Chapter 55 | Rating: 5'}, {'title': 'Heroine Saves A Gentleman', 'url': 'https://clicknovel.net/novel/heroine-saves-a-gentleman/', 'info': 'Chapter 77 | Rating: 5'}, {'title': 'Wife Doting Addiction:My Abducted Tsundere Husband', 'url': 'https://clicknovel.net/novel/wife-doting-addiction%ef%bc%9amy-abducted-tsundere-husband/', 'info': 'Chapter 228 | Rating: 0'}, {'title': 'The Almighty Ring', 'url': 'https://clicknovel.net/novel/the-almighty-ring/', 'info': 'Chapter 1416 | Rating: 0'}, {'title': 'Divine Physician, Overbearing Wife: State Preceptor, Your Wife Has Fled Again!', 'url': 'https://clicknovel.net/novel/divine-physician-overbearing-wife-state-preceptor-your-wife-has-fled-again/', 'info': 'Chapter 1278 | Rating: 5'}, {'title': 'God Of Slaughter', 'url': 'https://clicknovel.net/novel/god-of-slaughter/', 'info': 'Chapter 1618 | Rating: 0'}, {'title': 'NEET Receives a Dating Sim Game Leveling System', 'url': 'https://clicknovel.net/novel/neet-receives-a-dating-sim-game-leveling-system/', 'info': 'Chapter 841 | Rating: 2'}, {'title': 'Hidden Assassin', 'url': 'https://clicknovel.net/novel/hidden-assassin/', 'info': 'Chapter 87 | Rating: 0'}, {'title': 'Rebirth Of The General’s Granddaughter', 'url': 'https://clicknovel.net/novel/rebirth-of-the-generals-granddaughter/', 'info': 'Chapter 102.4 | Rating: 0'}, {'title': 'Magic Gems Gourmet', 'url': 'https://clicknovel.net/novel/magic-gems-gourmet/', 'info': 'Chapter 22.3 | Rating: 0'}, {'title': 'Murder the Dream Guy', 'url': 'https://clicknovel.net/novel/murder-the-dream-guy/', 'info': 'Chapter 682 | Rating: 0'}, {'title': 'The Experimental Log of the Crazy Lich', 'url': 'https://clicknovel.net/novel/the-experimental-log-of-the-crazy-lich/', 'info': 'Chapter 789 | Rating: 0'}, {'title': 'Reborn Aristocrat: Return of the Vicious Heiress', 'url': 'https://clicknovel.net/novel/reborn-aristocrat-return-of-the-vicious-heiress/', 'info': 'Chapter 935 | Rating: 0'}, {'title': 'League of Legends: League of Unknowns', 'url': 'https://clicknovel.net/novel/league-of-legends-league-of-unknowns/', 'info': 'Chapter 532 | Rating: 0'}, {'title': 'Master of the End Times', 'url': 'https://clicknovel.net/novel/master-of-the-end-times/', 'info': 'Chapter 217 | Rating: 0'}, {'title': 'Medical Master', 'url': 'https://clicknovel.net/novel/medical-master/', 'info': 'Chapter 549 | Rating: 5'}, {'title': 'Crossing to the Future, it’s Not Easy to Be a Man', 'url': 'https://clicknovel.net/novel/crossing-to-the-future-its-not-easy-to-be-a-man/', 'info': 'Chapter 1444 | Rating: 5'}, {'title': 'All Soccer Abilities Are Now Mine!', 'url': 'https://clicknovel.net/novel/all-soccer-abilities-are-now-mine/', 'info': 'Chapter 341 | Rating: 4'}, {'title': 'Reign of the Hunters', 'url': 'https://clicknovel.net/novel/reign-of-the-hunters/', 'info': 'Chapter 266 | Rating: 0'}, {'title': 'Jujutsushi Wa Yuusha Ni Narenai', 'url': 'https://clicknovel.net/novel/jujutsushi-wa-yuusha-ni-narenai/', 'info': 'Chapter 1051 | Rating: 5'}, {'title': 'Dual Life ~Hiru wa Yuusha Party, Yoru wa Maou Gun~', 'url': 'https://clicknovel.net/novel/dual-life-hiru-wa-yuusha-party-yoru-wa-maou-gun/', 'info': 'Dual life Chapter 25 (part 1) | Rating: 5'}, {'title': 'Ankoku Kishi Monogatari', 'url': 'https://clicknovel.net/novel/ankoku-kishi-monogatari/', 'info': 'Chapter 541 | Rating: 5'}, {'title': 'My Second Life is a Heroic Power Fantasy', 'url': 'https://clicknovel.net/novel/my-second-life-is-a-heroic-power-fantasy/', 'info': 'Chapter 210 | Rating: 5'}, {'title': 'The Amber Sword', 'url': 'https://clicknovel.net/novel/the-amber-sword/', 'info': 'Chapter v4c64 | Rating: 5'}]
2021-07-28 20:47:34,062 [INFO] (lncrawl.core.novel_search)
42 results from https://clicknovel.net/
2021-07-28 20:47:34,117 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): woopread.com:443
2021-07-28 20:47:34,633 [DEBUG] (urllib3.connectionpool)
https://m.webnovel.com:443 "GET / HTTP/1.1" 302 154
2021-07-28 20:47:34,646 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.webnovel.com:443
2021-07-28 20:47:34,849 [DEBUG] (urllib3.connectionpool)
https://www.novels.pl:443 "GET /?search=hero HTTP/1.1" 200 None
2021-07-28 20:47:35,016 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Heroine Wants To Be Oppressed By The Villainess!', 'url': 'https://noveltrench.com/manga/the-heroine-wants-to-be-oppressed-by-the-villainess/', 'info': 'Chapter 1 | Rating: 0'}, {'title': 'The Hero Proposed to Me', 'url': 'https://noveltrench.com/manga/the-hero-proposed-to-me/', 'info': 'Chapter 16.1 | Rating: 5'}, {'title': 'The Regressor Heroine and the Villainess Seeks to Coexist', 'url': 'https://noveltrench.com/manga/the-regressor-heroine-and-the-villainess-seeks-to-coexist/', 'info': 'Chapter 1 | Rating: 0'}, {'title': 'Not All Heroes From Earth Are Bad', 'url': 'https://noveltrench.com/manga/not-all-heroes-from-earth-are-bad/', 'info': 'Chapter 35 | Rating: 5'}, {'title': 'Survive As The Hero’s Wife', 'url': 'https://noveltrench.com/manga/survive-as-the-heros-wife/', 'info': 'Chapter 2 | Rating: 5'}, {'title': 'Deity Hero: Me! Gaining Disciples Makes Me Stronger!', 'url': 'https://noveltrench.com/manga/deity-hero-me-gaining-disciples-makes-me-stronger/', 'info': 'Chapter 190 | Rating: 4.7'}, {'title': 'A Mage Girl Expelled From a Hero Party Becomes The Mother of Twin Elves and The Strongest Mother Ever', 'url': 'https://noveltrench.com/manga/a-mage-girl-expelled-from-a-hero-party-becomes-the-mother-of-twin-elves-and-the-strongest-mother-ever/', 'info': 'chapter 11 | Rating: 0'}, {'title': 'The Emperor of Pantheron’s Unique Taste', 'url': 'https://noveltrench.com/manga/the-emperor-of-pantherons-unique-taste/', 'info': 'chapter 7.2 | Rating: 0'}, {'title': 'The heroes must die', 'url': 'https://noveltrench.com/manga/the-heroes-must-die/', 'info': 'Chapter 0 | Rating: 0'}, {'title': 'Orc Hero Story – Discovery Chronicles', 'url': 'https://noveltrench.com/manga/orc-hero-story-discovery-chronicles/', 'info': 'Chapter 19.2 | Rating: 3'}, {'title': 'Disciple of Immortal', 'url': 'https://noveltrench.com/manga/disciple-of-immortal/', 'info': 'Chapter 67 | Rating: 4'}, {'title': 'Quick Transmigration with Female Lead Aura', 'url': 'https://noveltrench.com/manga/quick-transmigration-with-female-lead-aura/', 'info': 'Chapter 95 | Rating: 3.3'}, {'title': 'The Heroine has Her Eyes on Me as Her Brother’s Wife', 'url': 'https://noveltrench.com/manga/the-heroine-has-her-eyes-on-me-as-her-brothers-wife/', 'info': 'Chapter 13 | Rating: 5'}, {'title': 'The Female Lead Turn Me into Her New Sister', 'url': 'https://noveltrench.com/manga/the-female-lead-turn-me-into-her-new-sister/', 'info': 'chapter 1 | Rating: 5'}, {'title': 'Ankoku Kishi Monogatari ~Yuusha wo Taosu Tameni Maou ni Shoukansaremashita~', 'url': 'https://noveltrench.com/manga/ankoku-kishi-monogatari-yuusha-wo-taosu-tameni-maou-ni-shoukansaremashita/', 'info': 'chapter 59.2 | Rating: 5'}, {'title': 'My Sister the Heroine, and I the Villainess', 'url': 'https://noveltrench.com/manga/my-sister-the-heroine-and-i-the-villainess/', 'info': 'chapter 30 | Rating: 5'}, {'title': 'My Lady, Please Become My Heroine!', 'url': 'https://noveltrench.com/manga/my-lady-please-become-my-heroine/', 'info': 'Chapter 13 | Rating: 5'}, {'title': 'The Discarded Hero wants to Return Home', 'url': 'https://noveltrench.com/manga/the-discarded-hero-wants-to-return-home/', 'info': 'chapter 6 | Rating: 0'}]
2021-07-28 20:47:35,027 [INFO] (lncrawl.core.novel_search)
18 results from https://noveltrench.com/
2021-07-28 20:47:35,051 [DEBUG] (urllib3.connectionpool)
https://www.webnovelover.com:443 "GET /?s=hero&post_type=wp-manga&op=&author=&artist=&release=&adult= HTTP/1.1" 200 13753
2021-07-28 20:47:35,092 [DEBUG] (urllib3.connectionpool)
https://vipnovel.com:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:35,138 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Mightiest Hero of Black ~My Party Members Betrayed Me so I’ll Stick With The Strongest Monster~', 'url': 'https://novelsite.net/novel/the-mightiest-hero-of-black-my-party-members-betrayed-me-so-ill-stick-with-the-strongest-monster-novel/', 'info': 'Chapter 16 - Black vs. Black\xa0\xa0\xa0 | Rating: 0'}, {'title': 'The Hero Who Returned Remains the Strongest in the Modern World', 'url': 'https://novelsite.net/novel/the-hero-who-returned-remains-the-strongest-in-the-modern-world-novel/', 'info': 'Chapter 15 | Rating: 0'}, {'title': 'The Discarded Hero wants to Return Home', 'url': 'https://novelsite.net/novel/the-discarded-hero-wants-to-return-home-novel/', 'info': 'Chapter 6 - Ep 6: Let’s start working! | Rating: 0'}, {'title': 'Treacherous Living in the Imperial Harem', 'url': 'https://novelsite.net/novel/treacherous-living-in-the-imperial-harem-novel/', 'info': 'Chapter 120 - Public trial | Rating: 5'}, {'title': 'The Return of the Condor Heroes', 'url': 'https://novelsite.net/novel/the-return-of-the-condor-heroes-novel/', 'info': 'Chapter 465 - Mediating Disputes (10) | Rating: 0'}, {'title': 'The Coming Heroine: The Only Princess', 'url': 'https://novelsite.net/novel/the-coming-heroine-the-only-princess-novel/', 'info': 'Chapter 268 - The Reappearance of “Meteor” | Rating: 0'}, {'title': 'Heroine Saves A Gentleman', 'url': 'https://novelsite.net/novel/heroine-saves-a-gentleman-novel/', 'info': 'Chapter 152 - The End | Rating: 0'}, {'title': 'Heroic Wife Reborn', 'url': 'https://novelsite.net/novel/heroic-wife-reborn-novel/', 'info': 'Chapter 154 - You Shouldn’t Have a Wife in this Lifetime | Rating: 0'}, {'title': 'FFF-Class Trashero', 'url': 'https://novelsite.net/novel/fff-class-trashero-novel/', 'info': 'Chapter 111 | Rating: 0'}, {'title': 'I Was Kicked out of the Hero’s Party Because I Wasn’t a True Companion so I Decided to Have a Slow Life at the Frontier', 'url': 'https://novelsite.net/novel/i-was-kicked-out-of-the-heros-party-because-i-wasnt-a-true-companion-so-i-decided-to-have-a-slow-life-at-the-frontier-novel/', 'info': 'Chapter 163 - Gideon’s answer | Rating: 0'}, {'title': 'Heroes of Marvel', 'url': 'https://novelsite.net/novel/heroes-of-marvel-novel/', 'info': 'Chapter 386 - WAKING UP | Rating: 0'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://novelsite.net/novel/shift-the-side-character-heroine-novel/', 'info': 'Chapter 773 (END) - The Eternal Heroine (Grand Finale) | Rating: 0'}, {'title': 'Reincarnation Of The Strongest Sword God', 'url': 'https://novelsite.net/novel/reincarnation-of-the-strongest-sword-god-novel/', 'info': 'No title | Rating: 0'}, {'title': 'Rebirth Of The Apocalypse Queen: On Your Knees, Young Emperor!', 'url': 'https://novelsite.net/novel/rebirth-of-the-apocalypse-queen-on-your-knees-young-emperor-novel/', 'info': 'Chapter 609 - Strange Village | Rating: 5'}, {'title': 'Worlds’ Apocalypse Online', 'url': 'https://novelsite.net/novel/worlds-apocalypse-online-novel/', 'info': 'Chapter 1454 - Chapter 1454 | Rating: 5'}, {'title': 'Divine Card Creator', 'url': 'https://novelsite.net/novel/divine-card-creator-novel/', 'info': 'Chapter 483 - Master, A Kind Man Is Always Harnessed | Rating: 4'}, {'title': 'Losing Money to Be a Tycoon', 'url': 'https://novelsite.net/novel/losing-money-to-be-a-tycoon-novel/', 'info': 'Chapter 987 - No King Rules Forever” | Rating: 0'}, {'title': 'Pocket Hunting Dimension', 'url': 'https://novelsite.net/novel/pocket-hunting-dimension-novel/', 'info': 'Chapter 1007 - Crisp Green Blade | Rating: 0'}, {'title': 'Super Detective in the Fictional World', 'url': 'https://novelsite.net/novel/super-detective-in-the-fictional-world-novel/', 'info': 'Chapter 1004 - D*mn, It Seems I Missed? | Rating: 4.5'}, {'title': 'Archean Eon Art', 'url': 'https://novelsite.net/novel/archean-eon-art-novel/', 'info': 'Chapter 766 (END) - Success (End) | Rating: 0'}]
2021-07-28 20:47:35,139 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): wordexcerpt.com:443
2021-07-28 20:47:35,149 [INFO] (lncrawl.core.novel_search)
20 results from https://novelsite.net/
2021-07-28 20:47:35,220 [DEBUG] (urllib3.connectionpool)
Starting new HTTP connection (1): wspadancewichita.com:80
2021-07-28 20:47:35,378 [DEBUG] (urllib3.connectionpool)
https://www.webnovel.com:443 "GET / HTTP/1.1" 200 None
2021-07-28 20:47:35,429 [DEBUG] (lncrawl.sources.webnovel)
CSRF Token = 28e7ac28-5ea7-4b2b-a7e0-9090e5fa03f7
2021-07-28 20:47:35,497 [DEBUG] (lncrawl.core.novel_search)
[{'url': 'https://www.readwn.com/novel/cyber-heroes.html', 'title': 'Cyber Heroes', 'info': '623 Chapters | 3 hours ago | Status: Ongoing'}, {'url': 'https://www.readwn.com/novel/what-to-do-when-the-heroine-of-the-comes-to-reality.html', 'title': 'What To Do When the Heroine of the Novel Comes To Reality', 'info': '349 Chapters | 1 days ago | Status: Completed'}, {'url': 'https://www.readwn.com/novel/fantasy-the-villains-hero.html', 'title': 'Fantasy: The Villain’s Hero', 'info': '1011 Chapters | 7 days ago | Status: Ongoing'}, {'url': 'https://www.readwn.com/novel/dominate-the-treacherous-realm.html', 'title': 'Dominate the Treacherous Realm', 'info': '977 Chapters | 14 days ago | Status: Completed'}, {'url': 'https://www.readwn.com/novel/i-dont-want-to-be-a-hero.html', 'title': 'I Don’t Want To Be a Hero', 'info': '983 Chapters | 14 hours ago | Status: Ongoing'}, {'url': 'https://www.readwn.com/novel/invincible-hero-of-necromancer.html', 'title': 'Invincible Hero of Necromancer', 'info': '2057 Chapters | 9 hours ago | Status: Ongoing'}, {'url': 'https://www.readwn.com/novel/hero-of-one-piece.html', 'title': 'Hero of One Piece', 'info': '285 Chapters | 31 days ago | Status: Ongoing'}, {'url': 'https://www.readwn.com/novel/strategy-hero-white-moonlight-quick-wear.html', 'title': 'Strategy Hero White Moonlight [Quick Wear]', 'info': '42 Chapters | 36 days ago | Status: Completed'}, {'url': 'https://www.readwn.com/novel/senior-green-tea-turned-into-an-abused-heroine.html', 'title': 'Senior Green Tea Turned Into an Abused Heroine', 'info': '79 Chapters | 36 days ago | Status: Completed'}, {'url': 'https://www.readwn.com/novel/heroines-road-to-becoming-scum.html', 'title': 'Heroine’s Road to Becoming Scum', 'info': '1039 Chapters | 36 days ago | Status: Completed'}]
2021-07-28 20:47:35,506 [INFO] (lncrawl.core.novel_search)
10 results from https://www.readwn.com/
2021-07-28 20:47:35,532 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'What To Do When the Heroine of the Novel Comes To Reality', 'url': 'https://1stkissnovel.love/novel/what-to-do-when-the-heroine-of-the-novel-comes-to-reality/', 'info': 'Chapter 341 | Rating: 0'}, {'title': 'The Hero Proposed to Me', 'url': 'https://1stkissnovel.love/novel/the-hero-proposed-to-me/', 'info': 'Chapter 16.2 | Rating: 3'}, {'title': 'Fantasy: The Villain’s Hero', 'url': 'https://1stkissnovel.love/novel/fantasy-the-villains-hero/', 'info': 'Chapter 1011 | Rating: 0'}, {'title': 'Dominate the Treacherous Realm', 'url': 'https://1stkissnovel.love/novel/dominate-the-treacherous-realm/', 'info': 'Chapter 977 | Rating: 0'}, {'title': 'Deity Hero: Me! Gaining Disciples Makes Me Stronger!', 'url': 'https://1stkissnovel.love/novel/deity-hero-me-gaining-disciples-makes-me-stronger/', 'info': 'Chapter 188: Traveling! | Rating: 0'}, {'title': 'I Don’t Want To Be a Hero', 'url': 'https://1stkissnovel.love/novel/i-dont-want-to-be-a-hero/', 'info': 'Chapter 978: Yeya: No one wants to hurt my family! | Rating: 0'}, {'title': 'Invincible Hero of Necromancer', 'url': 'https://1stkissnovel.love/novel/invincible-hero-of-necromancer/', 'info': ' Chapter 2055: Angel puzzle | Rating: 0'}, {'title': 'Heroine’s Road to Becoming Scum', 'url': 'https://1stkissnovel.love/novel/heroines-road-to-becoming-scum/', 'info': 'Chapter 1037 | Rating: 5'}, {'title': 'Heroic Wife Reborn', 'url': 'https://1stkissnovel.love/novel/heroic-wife-reborn/', 'info': 'Extra 4 | Rating: 0'}, {'title': 'Treacherous Living in the Imperial Harem', 'url': 'https://1stkissnovel.love/novel/treacherous-living-in-the-imperial-harem/', 'info': '~ | Rating: 0'}, {'title': 'Strategy Hero White Moonlight [Quick Wear]', 'url': 'https://1stkissnovel.love/novel/strategy-hero-white-moonlight-quick-wear/', 'info': 'Chapter 39 | Rating: 0'}, {'title': 'Those Years when Marvel was a Superhero', 'url': 'https://1stkissnovel.love/novel/those-years-when-marvel-was-a-superhero/', 'info': 'v12 Chapter 212 | Rating: 0'}, {'title': 'Superhero Comic – Overlord’s Path', 'url': 'https://1stkissnovel.love/novel/superhero-comic-overlords-path/', 'info': 'Chapter 836 | Rating: 0'}, {'title': 'Senior Green Tea Turned Into an Abused Heroine', 'url': 'https://1stkissnovel.love/novel/senior-green-tea-turned-into-an-abused-heroine/', 'info': 'Chapter 78 | Rating: 5'}, {'title': 'Quick Transmigration: Heroine Arrives, Woman Rapidly Retreats!', 'url': 'https://1stkissnovel.love/novel/quick-transmigration-heroine-arrives-woman-rapidly-retreats/', 'info': 'Chapter 2214 | Rating: 0'}, {'title': 'The Simple Job of Only Perishing to the Hero', 'url': 'https://1stkissnovel.love/novel/the-simple-job-of-only-perishing-to-the-hero/', 'info': 'Book 10: Chapter 21: (3) | Rating: 0'}, {'title': 'The Village Girl Who Was Forced to Become the Hero', 'url': 'https://1stkissnovel.love/novel/the-village-girl-who-was-forced-to-become-the-hero/', 'info': 'chapter 99 | Rating: 0'}, {'title': 'Heroic Death System', 'url': 'https://1stkissnovel.love/novel/heroic-death-system/', 'info': 'Chapter 275 | Rating: 5'}, {'title': 'God Rank Hero', 'url': 'https://1stkissnovel.love/novel/god-rank-hero/', 'info': 'Chapter 2063 | Rating: 0'}, {'title': 'I Play DC Hero In Marvel', 'url': 'https://1stkissnovel.love/novel/i-play-dc-hero-in-marvel/', 'info': 'Chapter 386: Nick Fury is an alien? The earth is so terrible! | Rating: 0'}, {'title': 'Harry Potter and the Dragon Prince', 'url': 'https://1stkissnovel.love/novel/harry-potter-and-the-dragon-prince/', 'info': 'Chapter 496 | Rating: 0'}, {'title': 'The Treasure Hunt of an Antique Dealer', 'url': 'https://1stkissnovel.love/novel/the-treasure-hunt-of-an-antique-dealer/', 'info': 'Chapter 1941 | Rating: 0'}, {'title': 'While Others Cultivate, I Use My Unique RPG Leveling System to Cultivate Smut Romance With Their Girlfriends!', 'url': 'https://1stkissnovel.love/novel/while-others-cultivate-i-use-my-unique-rpg-leveling-system-to-cultivate-smut-romance-with-their-girlfriends-2/', 'info': 'Chapter 633: Bet against eternity (epilogue of the prologue, part 2, END) | Rating: 0'}, {'title': 'Pampered Cute Mommy & Awesome President Daddy', 'url': 'https://1stkissnovel.love/novel/pampered-cute-mommy-awesome-president-daddy-2/', 'info': 'Chapter 733 | Rating: 0'}, {'title': 'Mech Journey', 'url': 'https://1stkissnovel.love/novel/mech-journey/', 'info': 'Chapter 752 | Rating: 0'}, {'title': 'The Brave Master Is the Demon King', 'url': 'https://1stkissnovel.love/novel/the-brave-master-is-the-demon-king/', 'info': 'Vol 2 Chapter 875: Enemy attack | Rating: 0'}, {'title': 'I Am The Little Green Plum In The Heroine Of Heaven', 'url': 'https://1stkissnovel.love/novel/i-am-the-little-green-plum-in-the-heroine-of-heaven/', 'info': 'Chapter 98 | Rating: 5'}, {'title': 'Ankoku Kishi Monogatari ~Yuusha wo Taosu Tameni Maou ni Shoukansaremashita~', 'url': 'https://1stkissnovel.love/novel/ankoku-kishi-monogatari-yuusha-wo-taosu-tameni-maou-ni-shoukansaremashita/', 'info': 'Chapter 67.4: Sword Dancer | Rating: 5'}, {'title': 'The Laid-back Life in Another World of the Ex-Hero Candidate Who Turned out to be a Cheat from Level 2', 'url': 'https://1stkissnovel.love/novel/the-laid-back-life-in-another-world-of-the-ex-hero-candidate-who-turned-out-to-be-a-cheat-from-level-2the-laid-back-life-in-another-world-of-the-ex-hero-candidate-who-turned-out-to-be-a-cheat-from-lev/', 'info': 'Chapter 112 Part 1 | Rating: 0'}, {'title': 'Hero? I’ve Long Stopped Being One', 'url': 'https://1stkissnovel.love/novel/hero-ive-long-stopped-being-one/', 'info': 'Volume 2 Chapter 8 | Rating: 0'}, {'title': 'Sendai Yuusha wa Inkyou Shitai', 'url': 'https://1stkissnovel.love/novel/sendai-yuusha-wa-inkyou-shitai/', 'info': 'Chapter 152 – The Preceding Hero and the Witch of Time | Rating: 0'}]
2021-07-28 20:47:35,587 [INFO] (lncrawl.core.novel_search)
31 results from https://1stkissnovel.love/
2021-07-28 20:47:35,591 [DEBUG] (urllib3.connectionpool)
Starting new HTTP connection (1): wuxiaworld.cloud:80
2021-07-28 20:47:35,599 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Deity Hero: Me! Gaining Disciples Makes Me Stronger! Novel', 'url': 'https://skynovel.org/manga/deity-hero-me-gaining-disciples-makes-me-stronger-novel/', 'info': 'Chapter 191 | Rating: 5'}, {'title': 'Immortal Hero: I Can See the Success Rate Novel', 'url': 'https://skynovel.org/manga/immortal-hero-i-can-see-the-success-rate-novel/', 'info': 'Chapter 121 | Rating: 4.5'}, {'title': 'Immortal Hero: I Can Replicate Talents Novel', 'url': 'https://skynovel.org/manga/immortal-hero-i-can-replicate-talents-novel/', 'info': 'Chapter 43 | Rating: 5'}, {'title': 'Magic Returns Evolving As A Willow Tree Novel', 'url': 'https://skynovel.org/manga/magic-returns-evolving-as-a-willow-tree-novel/', 'info': 'Chapter 1 | Rating: 5'}, {'title': 'The God of War Challenging Heaven Novel', 'url': 'https://skynovel.org/manga/the-god-of-war-challenging-heaven-novel/', 'info': 'Chapter 94 | Rating: 4'}, {'title': 'Absolute Great Teacher Novel', 'url': 'https://skynovel.org/manga/absolute-great-teacher-novel/', 'info': 'Chapter 756 | Rating: 3.8'}, {'title': 'The Schoolgirl Secret Agent Novel', 'url': 'https://skynovel.org/manga/the-schoolgirl-secret-agent-novel/', 'info': 'Chapter 731 | Rating: 5'}, {'title': 'Plague Doctor Novel', 'url': 'https://skynovel.org/manga/plague-doctor-novel/', 'info': 'Chapter 478 | Rating: 5'}, {'title': 'Earth’s Best Gamer Novel', 'url': 'https://skynovel.org/manga/earths-best-gamer-novel/', 'info': 'Chapter 525 | Rating: 4.3'}]
2021-07-28 20:47:35,631 [INFO] (lncrawl.core.novel_search)
9 results from https://skynovel.org/
2021-07-28 20:47:35,622 [DEBUG] (urllib3.connectionpool)
https://woopread.com:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:35,665 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): zinnovel.com:443
2021-07-28 20:47:35,675 [DEBUG] (lncrawl.sources.wuxiaco)
Visiting https://wuxiaworld.co/search/hero/1
2021-07-28 20:47:35,676 [DEBUG] (urllib3.connectionpool)
https://wordexcerpt.com:443 "GET /?s=hero&post_type=wp-manga HTTP/1.1" 200 None
2021-07-28 20:47:35,709 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): wuxiaworld.co:443
2021-07-28 20:47:35,957 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Hero Prince(ss)', 'url': 'https://www.scribblehub.com/series/2148/hero-princess/', 'info': '5.6k Views 13 Favorites 4 Chapters 0 Chapters/Week 112 Readers 0 Reviews 12.1k Words Jan 8, 2019 Ai-chan'}, {'title': 'Oh No! I Transmigrated Into a World Full of Generic Isekai Heroes!', 'url': 'https://www.scribblehub.com/series/2370/oh-no-i-transmigrated-into-a-world-full-of-generic-isekai-heroes/', 'info': '5.3k Views 26 Favorites 3 Chapters 0 Chapters/Week 175 Readers 0 Reviews 686 Words Apr 9, 2021 reika'}, {'title': 'Child of Fate, Bridge of Heroes', 'url': 'https://www.scribblehub.com/series/3052/child-of-fate-bridge-of-heroes/', 'info': '198 Views 0 Favorites 1 Chapters 0 Chapters/Week 4 Readers 0 Reviews 3k Words Feb 8, 2019 Ryuubii'}, {'title': 'The Villainous Heroine', 'url': 'https://www.scribblehub.com/series/3369/the-villainous-heroine/', 'info': '30k Views 102 Favorites 4 Chapters 0 Chapters/Week 478 Readers 0 Reviews 8.1k Words Jan 24, 2019 Justderpin'}, {'title': 'Heroes of the Past', 'url': 'https://www.scribblehub.com/series/3512/heroes-of-the-past/', 'info': '44.6k Views 275 Favorites 294 Chapters 2 Chapters/Week 375 Readers 3 Reviews 522.4k Words 16 hours ago delta0G'}, {'title': 'The Reincarnated Guider who Desires to be a Hero', 'url': 'https://www.scribblehub.com/series/3770/the-reincarnated-guider-who-desires-to-be-a-hero/', 'info': '720 Views 4 Favorites 3 Chapters 0 Chapters/Week 23 Readers 0 Reviews 4.1k Words May 6, 2021 Aoi_Sora'}, {'title': 'The Hero’s Supplier', 'url': 'https://www.scribblehub.com/series/4598/the-heros-supplier/', 'info': '255.2k Views 2694 Favorites 93 Chapters 0 Chapters/Week 1139 Readers 8 Reviews 157.7k Words Jun 1, 2020 Cold_Sun'}, {'title': 'The Hero Of Light', 'url': 'https://www.scribblehub.com/series/6103/the-hero-of-light/', 'info': '850 Views 7 Favorites 2 Chapters 0 Chapters/Week 26 Readers 0 Reviews 1.6k Words Jan 20, 2019 Rank_9_Magus'}, {'title': 'The Cursed Black Hero', 'url': 'https://www.scribblehub.com/series/8984/the-cursed-black-hero/', 'info': '48.3k Views 403 Favorites 77 Chapters 0 Chapters/Week 244 Readers 3 Reviews 300k Words Jun 23, 2021 Vain_1997'}, {'title': 'Downfall of the nanite hero', 'url': 'https://www.scribblehub.com/series/11364/downfall-of-the-nanite-hero/', 'info': '1.3k Views 9 Favorites 12 Chapters 0 Chapters/Week 8 Readers 0 Reviews 21.9k Words Feb 11, 2019 xihawkix'}, {'title': 'Hero City', 'url': 'https://www.scribblehub.com/series/11942/hero-city/', 'info': '711 Views 0 Favorites 4 Chapters 0 Chapters/Week 11 Readers 0 Reviews 9.3k Words Sep 3, 2019 Deadrocks'}, {'title': 'A Hero’s Adventure and The Black Alchemist', 'url': 'https://www.scribblehub.com/series/12012/a-heros-adventure-and-the-black-alchemist/', 'info': '6.1k Views 22 Favorites 6 Chapters 0 Chapters/Week 72 Readers 2 Reviews 10.8k Words Mar 4, 2019 Havok'}, {'title': 'RIng Hero', 'url': 'https://www.scribblehub.com/series/15373/ring-hero/', 'info': '229 Views 0 Favorites 1 Chapters 0 Chapters/Week 1 Readers 1 Reviews 250 Words Mar 7, 2019 BlameMyFather199'}, {'title': 'Raven Hero', 'url': 'https://www.scribblehub.com/series/18842/raven-hero/', 'info': '1.1k Views 0 Favorites 2 Chapters 0 Chapters/Week 13 Readers 0 Reviews 2.2k Words Apr 28, 2019 EYA'}, {'title': 'The Insane Sequel of the Hero’s Journey', 'url': 'https://www.scribblehub.com/series/19201/the-insane-sequel-of-the-heros-journey/', 'info': '1.5k Views 0 Favorites 1 Chapters 0 Chapters/Week 3 Readers 0 Reviews 1.1k Words Mar 29, 2019 DKofDarknessflame1'}, {'title': 'The Unabridged Guide To Being A Superhero', 'url': 'https://www.scribblehub.com/series/23818/the-unabridged-guide-to-being-a-superhero/', 'info': '152 Views 0 Favorites 1 Chapters 0 Chapters/Week 3 Readers 0 Reviews 1.4k Words May 4, 2019 ultravioletwinter'}, {'title': 'The Evolution: Rise of the Heroes', 'url': 'https://www.scribblehub.com/series/26779/the-evolution-rise-of-the-heroes/', 'info': '20.9k Views 186 Favorites 29 Chapters 0 Chapters/Week 179 Readers 2 Reviews 43.2k Words Jun 16, 2019 Paraknight'}, {'title': 'The “Heroine Rising Project” is out of this world?!', 'url': 'https://www.scribblehub.com/series/30896/the-heroine-rising-project-is-out-of-this-world/', 'info': '3.9k Views 5 Favorites 14 Chapters 1 Chapters/Week 62 Readers 0 Reviews 32k Words Jul 22, 2021 WeissBlatt'}, {'title': 'The Legend of the Fake Hero', 'url': 'https://www.scribblehub.com/series/34196/the-legend-of-the-fake-hero/', 'info': '94.2k Views 1272 Favorites 110 Chapters 1 Chapters/Week 627 Readers 3 Reviews 463.8k Words Jul 18, 2021 mrmitch246'}, {'title': 'Can a holy hero be born from such a person?', 'url': 'https://www.scribblehub.com/series/37080/can-a-holy-hero-be-born-from-such-a-person/', 'info': '10.5k Views 9 Favorites 182 Chapters 0 Chapters/Week 78 Readers 0 Reviews 156.5k Words Sep 24, 2019 muhammadazmee94'}, {'title': 'The Demon Lord decided to marry the hero to win', 'url': 'https://www.scribblehub.com/series/39414/the-demon-lord-decided-to-marry-the-hero-to-win/', 'info': '48.8k Views 513 Favorites 84 Chapters 2 Chapters/Week 428 Readers 1 Reviews 245.4k Words Jul 23, 2021 Blue_Spider_Lily'}, {'title': 'Misadventures of Unlikely Heroes', 'url': 'https://www.scribblehub.com/series/43526/misadventures-of-unlikely-heroes/', 'info': '263 Views 0 Favorites 4 Chapters 0 Chapters/Week 3 Readers 0 Reviews 17.6k Words Aug 31, 2019 Asheleigh'}, {'title': 'The Necromancer and the Would-Be-Hero', 'url': 'https://www.scribblehub.com/series/50210/the-necromancer-and-the-wouldbehero/', 'info': '150.1k Views 2118 Favorites 63 Chapters 0 Chapters/Week 1064 Readers 5 Reviews 202.7k Words May 23, 2020 UndyingEmbers'}, {'title': 'Let’s work together!- To defeat a heroine', 'url': 'https://www.scribblehub.com/series/52008/lets-work-together-to-defeat-a-heroine/', 'info': '3.6k Views 33 Favorites 5 Chapters 0 Chapters/Week 78 Readers 0 Reviews 6.9k Words Sep 21, 2019 zombiequeenkai'}, {'title': 'Cursed Heroine', 'url': 'https://www.scribblehub.com/series/53675/cursed-heroine/', 'info': '608k Views 9074 Favorites 74 Chapters 0 Chapters/Week 2458 Readers 9 Reviews 125.6k Words Mar 29, 2021 NightOps'}]
2021-07-28 20:47:35,964 [INFO] (lncrawl.core.novel_search)
25 results from https://www.scribblehub.com/
2021-07-28 20:47:35,975 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Hero Returns', 'url': 'https://readwebnovels.net/novel/the-hero-returns/', 'info': 'Chapter 382 | Rating: 4.2'}, {'title': 'I Was Caught up in a Hero Summoning, but That World Is at Peace', 'url': 'https://readwebnovels.net/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/', 'info': 'Chapter 766 | Rating: 4.3'}, {'title': 'My Status as an Assassin Obviously Exceeds the Hero’s', 'url': 'https://readwebnovels.net/novel/my-status-as-an-assassin-obviously-exceeds-the-heros/', 'info': 'Chapter 186 | Rating: 3.7'}, {'title': 'FFF-Class Trashero', 'url': 'https://readwebnovels.net/novel/fff-class-trashero/', 'info': 'Chapter 130 | Rating: 4.6'}, {'title': 'Kill the Hero', 'url': 'https://readwebnovels.net/novel/kill-the-hero/', 'info': 'Chapter 275 | Rating: 4.8'}, {'title': 'From The Strongest Job of Dragon Knight, To The Beginner Job Carrier, Somehow, The Heroes are Depending on Me', 'url': 'https://readwebnovels.net/novel/from-the-strongest-job-of-dragon-knight-to-the-beginner-job-carrier-somehow-the-heroes-are-depending-on-me/', 'info': 'Chapter 11 | Rating: 4'}, {'title': 'Martial Hero Rebirth', 'url': 'https://readwebnovels.net/novel/martial-hero-rebirth/', 'info': 'Chapter 93 | Rating: 4'}, {'title': 'The Regressed Demon Lord is Kind', 'url': 'https://readwebnovels.net/novel/the-regressed-demon-lord-is-kind/', 'info': 'Chapter 72 | Rating: 4'}, {'title': 'I am a Gao Fushuai Villain', 'url': 'https://readwebnovels.net/novel/i-am-a-gao-fushuai-villain/', 'info': 'Chapter 232 | Rating: 4.5'}, {'title': 'The Evolution of a Goblin to the Peak', 'url': 'https://readwebnovels.net/novel/the-evolution-of-a-goblin-to-the-peak/', 'info': 'Chapter 382 | Rating: 3.8'}, {'title': 'Hagure Yuusha no Kichiku Bigaku', 'url': 'https://readwebnovels.net/novel/hagure-yuusha-no-kichiku-bigaku/', 'info': 'Prologue | Rating: 4'}, {'title': 'Almadianos Eiyuuden', 'url': 'https://readwebnovels.net/novel/almadianos-eiyuuden/', 'info': 'Chapter 129 | Rating: 4.5'}]
2021-07-28 20:47:35,997 [INFO] (lncrawl.core.novel_search)
12 results from https://readwebnovels.net/
2021-07-28 20:47:36,018 [INFO] (lncrawl.sources.wuxiacom)
Visiting https://www.wuxiaworld.com/api/novels/search?query=hero&count=5 ...
2021-07-28 20:47:36,020 [DEBUG] (urllib3.connectionpool)
http://wspadancewichita.com:80 "GET /search?keyword=hero HTTP/1.1" 200 None
2021-07-28 20:47:36,052 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.wuxiaworld.com:443
2021-07-28 20:47:36,061 [DEBUG] (urllib3.connectionpool)
https://www.webnovel.com:443 "GET /go/pcm/search/result?_csrfToken=28e7ac28-5ea7-4b2b-a7e0-9090e5fa03f7&pageIndex=1&type=1&keywords=hero HTTP/1.1" 200 None
2021-07-28 20:47:36,064 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): wuxiaworld.io:443
2021-07-28 20:47:36,080 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Hero Returns', 'url': 'https://www.webnovel.com/book/14591123005870105', 'info': 'Fantasy | Score: 4.35'}, {'title': 'My (Monster?) Hero Life', 'url': 'https://www.webnovel.com/book/17781304206011105', 'info': 'Fantasy | Score: 4.69'}, {'title': 'The Insurrection of the Inept Hero', 'url': 'https://www.webnovel.com/book/19241315405763705', 'info': 'Fantasy | Score: 4.43'}, {'title': 'Edea: Hero Summoning Conspiracy', 'url': 'https://www.webnovel.com/book/11075053406249205', 'info': 'Fantasy | Score: 4.46'}, {'title': 'This Hero is Too Curious!', 'url': 'https://www.webnovel.com/book/17108921305492805', 'info': 'Fantasy | Score: 4.86'}, {'title': 'Reincarnated As The Hero Ring', 'url': 'https://www.webnovel.com/book/15773946405908905', 'info': 'Fantasy | Score: 4.01'}, {'title': 'SON OF THE HERO KING', 'url': 'https://www.webnovel.com/book/17721810805532405', 'info': 'Fantasy | Score: 4.81'}, {'title': "I'm Not A Hero!", 'url': 'https://www.webnovel.com/book/18787515806165405', 'info': 'Fantasy Romance | Score: 4.95'}, {'title': 'Counterfeit Hero', 'url': 'https://www.webnovel.com/book/6831843102000605', 'info': 'War&Military | Score: 3.94'}, {'title': 'Crocodiles hero academia. {complete}', 'url': 'https://www.webnovel.com/book/17420016405792405', 'info': 'Fantasy | Score: 4.25'}, {'title': 'Hero Extraction System', 'url': 'https://www.webnovel.com/book/16540991305313305', 'info': 'Fantasy | Score: 4.26'}, {'title': 'Livestream Hero', 'url': 'https://www.webnovel.com/book/19756516906298905', 'info': 'Martial Arts | Score: 0'}, {'title': 'Hero of Darkness', 'url': 'https://www.webnovel.com/book/20433994506434305', 'info': 'Fantasy | Score: 0'}, {'title': 'The Succubus Hero', 'url': 'https://www.webnovel.com/book/19749815605129805', 'info': 'Fantasy | Score: 0'}, {'title': 'Fallen Hero: Narcos', 'url': 'https://www.webnovel.com/book/19047837006213805', 'info': 'Fantasy | Score: 4.88'}, {'title': 'God-Level Hero', 'url': 'https://www.webnovel.com/book/16490243006240405', 'info': 'Video Games | Score: 4.14'}, {'title': 'The Black Hero', 'url': 'https://www.webnovel.com/book/20612655105981205', 'info': 'Sci-fi | Score: 0'}, {'title': 'A Forgotten Hero', 'url': 'https://www.webnovel.com/book/13631230005532105', 'info': 'Martial Arts | Score: 0'}, {'title': 'Heroes of marvel', 'url': 'https://www.webnovel.com/book/16300006406606705', 'info': 'Fantasy | Score: 3.57'}, {'title': 'The Hero System', 'url': 'https://www.webnovel.com/book/10905415606203605', 'info': 'Magical Realism | Score: 4.53'}]
2021-07-28 20:47:36,088 [INFO] (lncrawl.core.novel_search)
20 results from https://m.webnovel.com/
2021-07-28 20:47:36,138 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): wuxiaworld.live:443
2021-07-28 20:47:36,205 [DEBUG] (urllib3.connectionpool)
https://wondernovels.com:443 "GET /?s=hero&post_type=wp-manga HTTP/1.1" 200 None
2021-07-28 20:47:36,451 [DEBUG] (urllib3.connectionpool)
https://wuxiaworld.co:443 "GET /search/hero/1 HTTP/1.1" 301 None
2021-07-28 20:47:36,494 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.wuxiaworld.co:443
2021-07-28 20:47:36,503 [DEBUG] (root)
Searching failure for https://tunovelaligera.com/
2021-07-28 20:47:36,790 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Deity Hero: Me! Gaining Disciples Makes Me Stronger!', 'url': 'https://novelsrock.com/novel/deity-hero-me-gaining-disciples-makes-me-stronger/', 'info': 'Chapter 89 | Rating: 3.8'}, {'title': 'My Hero', 'url': 'https://novelsrock.com/novel/my-hero/', 'info': 'short story (END) | Rating: 2.2'}, {'title': 'My Sister the Heroine, and I the Villainess', 'url': 'https://novelsrock.com/novel/my-sister-the-heroine-and-i-the-villainess/', 'info': 'Chapter 115 | Rating: 4.3'}, {'title': 'Running Away From The Hero! (Remake)', 'url': 'https://novelsrock.com/novel/running-away-from-the-hero-remake/', 'info': 'Chapter 120 | Rating: 4.3'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://novelsrock.com/novel/shift-the-side-character-heroine/', 'info': 'Chapter 773 (END) | Rating: 4.2'}, {'title': 'I Was Kicked out of the Hero’s Party Because I Wasn’t a True Companion so I Decided to Have a Slow Life at the Frontier', 'url': 'https://novelsrock.com/novel/i-was-kicked-out-of-the-heros-party-because-i-wasnt-a-true-companion-so-i-decided-to-have-a-slow-life-at-the-frontier/', 'info': 'Chapter 163 | Rating: 4'}, {'title': 'FFF-Class Trashero', 'url': 'https://novelsrock.com/novel/fff-class-trashero/', 'info': 'Chapter 111 | Rating: 3.8'}, {'title': 'Immortal Hero: I Can Replicate Talents', 'url': 'https://novelsrock.com/novel/immortal-hero-i-can-replicate-talents/', 'info': 'Chapter 43 | Rating: 3.6'}, {'title': 'Immortal Hero: I Can See the Success Rate', 'url': 'https://novelsrock.com/novel/immortal-hero-i-can-see-the-success-rate/', 'info': 'Chapter 76 | Rating: 3.6'}, {'title': 'Hero without Blood or Tear', 'url': 'https://novelsrock.com/novel/hero-without-blood-or-tear/', 'info': 'Chapter 223 | Rating: 5'}]
2021-07-28 20:47:36,791 [INFO] (lncrawl.core.novel_search)
10 results from https://novelsrock.com/
2021-07-28 20:47:36,888 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Heroine Saves A Gentleman', 'url': 'https://www.webnovelover.com/novel/heroine-saves-a-gentleman/', 'info': 'Chapter 5 | Rating: 5'}]
2021-07-28 20:47:36,920 [INFO] (lncrawl.core.novel_search)
1 results from https://www.webnovelover.com/
2021-07-28 20:47:36,901 [DEBUG] (urllib3.connectionpool)
http://wuxiaworld.cloud:80 "GET /search?keyword=hero HTTP/1.1" 200 None
2021-07-28 20:47:36,983 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Hero Proposed to Me', 'url': 'https://supernovel.net/novel/the-hero-proposed-to-me/', 'info': 'Chapter 16.2 | Rating: 4.5'}, {'title': 'Not All Heroes From Earth Are Bad', 'url': 'https://supernovel.net/novel/not-all-heroes-from-earth-are-bad/', 'info': 'Chapter 35 | Rating: 5'}, {'title': 'Deity Hero: Me! Gaining Disciples Makes Me Stronger!', 'url': 'https://supernovel.net/novel/deity-hero-me-gaining-disciples-makes-me-stronger/', 'info': 'Chapter 190 | Rating: 5'}, {'title': 'After Becoming the Hero’s Ex-fiancée', 'url': 'https://supernovel.net/novel/after-becoming-the-heros-ex-fiancee/', 'info': 'Chapter 26 | Rating: 5'}, {'title': 'Immortal Hero: I Can See the Success Rate', 'url': 'https://supernovel.net/novel/immortal-hero-i-can-see-the-success-rate/', 'info': 'Chapter 121 | Rating: 4.5'}, {'title': 'Immortal Hero: I Can Replicate Talents', 'url': 'https://supernovel.net/novel/immortal-hero-i-can-replicate-talents/', 'info': 'Chapter 43 | Rating: 5'}, {'title': 'kill the hero', 'url': 'https://supernovel.net/novel/kill-the-hero/', 'info': 'Pr | Rating: 5'}, {'title': 'Lords Trying to Survive: Strategizing from a Rundown Yard', 'url': 'https://supernovel.net/novel/lords-trying-to-survive-strategizing-from-a-rundown-yard/', 'info': 'Chapter 40 | Rating: 5'}, {'title': 'Return back into the Novel as the Antagonistic Playboy', 'url': 'https://supernovel.net/novel/return-back-into-the-novel-as-the-antagonistic-playboy/', 'info': 'Chapter 42 | Rating: 5'}, {'title': 'To You Who Never Loved Me', 'url': 'https://supernovel.net/novel/to-you-who-never-loved-me/', 'info': 'Chapter 12 | Rating: 4'}, {'title': 'The Evolution of a Goblin to the Peak', 'url': 'https://supernovel.net/novel/the-evolution-of-a-goblin-to-the-peak/', 'info': 'Pr | Rating: 5'}, {'title': 'I am a Gao Fushuai Villain', 'url': 'https://supernovel.net/novel/i-am-a-gao-fushuai-villain/', 'info': 'Chapter 232 | Rating: 5'}, {'title': 'Please Love Me From Now On!', 'url': 'https://supernovel.net/novel/please-love-me-from-now-on/', 'info': 'Chapter 6 | Rating: 5'}, {'title': 'My Dungeons Are Popular', 'url': 'https://supernovel.net/novel/my-dungeons-are-popular/', 'info': 'Chapter 91 | Rating: 5'}, {'title': 'After Signing In For a Hundred Years, I Have Become the Big Brother of Vampires', 'url': 'https://supernovel.net/novel/after-signing-in-for-a-hundred-years-i-have-become-the-big-brother-of-vampires/', 'info': 'Chapter 40 | Rating: 5'}, {'title': 'My Fusion System: Fusing a Thousand Chickens at the Start', 'url': 'https://supernovel.net/novel/my-fusion-system-fusing-a-thousand-chickens-at-the-start/', 'info': 'Chapter 200 | Rating: 4.3'}, {'title': 'I Really Am Not The Lord of Demon', 'url': 'https://supernovel.net/novel/i-really-am-not-the-lord-of-demon/', 'info': 'Chapter 378 | Rating: 5'}]
2021-07-28 20:47:36,989 [INFO] (lncrawl.core.novel_search)
17 results from https://supernovel.net/
2021-07-28 20:47:37,014 [DEBUG] (lncrawl.core.novel_search)
[{'title': '', 'url': 'https://www.novels.pl/novel/Heroes-of-Marvel', 'info': ''}, {'title': 'Heroes of Marvel', 'url': 'https://www.novels.pl/novel/Heroes-of-Marvel', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/Heroes-Shed-No-Tears-Novels', 'info': ''}, {'title': 'Heroes Shed No Tears', 'url': 'https://www.novels.pl/novel/Heroes-Shed-No-Tears-Novels', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/Heroine-of-the-Broken-Engagement', 'info': ''}, {'title': 'Heroine of the Broken Engagement', 'url': 'https://www.novels.pl/novel/Heroine-of-the-Broken-Engagement', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/My-Hero', 'info': ''}, {'title': 'My Hero', 'url': 'https://www.novels.pl/novel/My-Hero', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/No-Hero', 'info': ''}, {'title': 'No Hero', 'url': 'https://www.novels.pl/novel/No-Hero', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/Twin-Heroes', 'info': ''}, {'title': 'Twin Heroes', 'url': 'https://www.novels.pl/novel/Twin-Heroes', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/Me-a-Hero-Not-Possible', 'info': ''}, {'title': 'Me, a Hero? Not Possible!', 'url': 'https://www.novels.pl/novel/Me-a-Hero-Not-Possible', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/Kill-the-Hero', 'info': ''}, {'title': 'Kill the Hero', 'url': 'https://www.novels.pl/novel/Kill-the-Hero', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/Demon-King--Hero', 'info': ''}, {'title': 'Demon King & Hero', 'url': 'https://www.novels.pl/novel/Demon-King--Hero', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/Ultimate-Antihero', 'info': ''}, {'title': 'Ultimate Antihero', 'url': 'https://www.novels.pl/novel/Ultimate-Antihero', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/I-Became-the-Heros-Bride', 'info': ''}, {'title': 'I Became the Hero’s Bride!', 'url': 'https://www.novels.pl/novel/I-Became-the-Heros-Bride', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/FFFClass-Trashero', 'info': ''}, {'title': 'FFF-Class Trashero', 'url': 'https://www.novels.pl/novel/FFFClass-Trashero', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/My-Sister-the-Heroine-and-I-the-Villainess-Novel', 'info': ''}, {'title': 'My Sister the Heroine, and I the Villainess', 'url': 'https://www.novels.pl/novel/My-Sister-the-Heroine-and-I-the-Villainess-Novel', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/The-Mightiest-Hero-of-Black-My-Party-Members-Betrayed-Me-so-Ill-Stick-With-The-Strongest-Monster', 'info': ''}, {'title': 'The Mightiest Hero of Black ~My Party Members Betrayed Me so I’ll Stick With The Strongest Monster~', 'url': 'https://www.novels.pl/novel/The-Mightiest-Hero-of-Black-My-Party-Members-Betrayed-Me-so-Ill-Stick-With-The-Strongest-Monster', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/My-Father-is-a-Hero-My-Mother-is-a-Spirit-the-Daughter-Me-is-a-Reincarnator', 'info': ''}, {'title': 'My Father is a Hero, My Mother is a Spirit, the Daughter (Me) is a Reincarnator.', 'url': 'https://www.novels.pl/novel/My-Father-is-a-Hero-My-Mother-is-a-Spirit-the-Daughter-Me-is-a-Reincarnator', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/Return-of-the-Former-Hero', 'info': ''}, {'title': 'Return of the Former Hero', 'url': 'https://www.novels.pl/novel/Return-of-the-Former-Hero', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/I-Was-Kicked-out-of-the-Heros-Party-Because-I-Wasnt-a-True-Companion-so-I-Decided-to-Have-a-Slow-Life-at-the-Frontier', 'info': ''}, {'title': 'I Was Kicked out of the Hero’s Party Because I Wasn’t a True Companion so I Decided to Have a Slow Life at the Frontier', 'url': 'https://www.novels.pl/novel/I-Was-Kicked-out-of-the-Heros-Party-Because-I-Wasnt-a-True-Companion-so-I-Decided-to-Have-a-Slow-Life-at-the-Frontier', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/The-Return-of-the-Condor-Heroes', 'info': ''}, {'title': 'The Return of the Condor Heroes', 'url': 'https://www.novels.pl/novel/The-Return-of-the-Condor-Heroes', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/Shift-The-Side-Character-Heroine-WebNovel', 'info': ''}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://www.novels.pl/novel/Shift-The-Side-Character-Heroine-WebNovel', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/The-Laidback-Life-in-Another-World-of-the-ExHero-Candidate-Who-Turned-out-to-be-a-Cheat-from-Level-2', 'info': ''}, {'title': 'The Laid-back Life in Another World of the Ex-Hero Candidate Who Turned out to be a Cheat from Level 2', 'url': 'https://www.novels.pl/novel/The-Laidback-Life-in-Another-World-of-the-ExHero-Candidate-Who-Turned-out-to-be-a-Cheat-from-Level-2', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/Maoyuu-Maou-Yuusha', 'info': ''}, {'title': 'Maoyuu Maou Yuusha', 'url': 'https://www.novels.pl/novel/Maoyuu-Maou-Yuusha', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/Tate-no-Yuusha-no-Nariagari-WN', 'info': ''}, {'title': 'Tate no Yuusha no Nariagari', 'url': 'https://www.novels.pl/novel/Tate-no-Yuusha-no-Nariagari-WN', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/The-Demon-Lords-Second-Marriage', 'info': ''}, {'title': 'The Demon Lord’s Second Marriage', 'url': 'https://www.novels.pl/novel/The-Demon-Lords-Second-Marriage', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/Nidome-no-Yuusha', 'info': ''}, {'title': 'Nidome no Yuusha', 'url': 'https://www.novels.pl/novel/Nidome-no-Yuusha', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/Washio-Sumi-wa-Yuusha-de-Aru', 'info': ''}, {'title': 'Washio Sumi wa Yuusha de Aru', 'url': 'https://www.novels.pl/novel/Washio-Sumi-wa-Yuusha-de-Aru', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/The-Labyrinth-Raids-of-the-Ultimate-Tank', 'info': ''}, {'title': 'The Labyrinth Raids of the Ultimate Tank', 'url': 'https://www.novels.pl/novel/The-Labyrinth-Raids-of-the-Ultimate-Tank', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/The-Amber-Sword', 'info': ''}, {'title': 'The Amber Sword', 'url': 'https://www.novels.pl/novel/The-Amber-Sword', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/Yuusha-no-Segare', 'info': ''}, {'title': 'Yuusha no Segare', 'url': 'https://www.novels.pl/novel/Yuusha-no-Segare', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/Suterareta-Yuusha-no-Eiyuutan', 'info': ''}, {'title': 'Suterareta Yuusha no Eiyuutan', 'url': 'https://www.novels.pl/novel/Suterareta-Yuusha-no-Eiyuutan', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/Ankoku-Kishi-Monogatari-Yuusha-wo-Taosu-Tameni-Maou-ni-Shoukansaremashita', 'info': ''}, {'title': 'Ankoku Kishi Monogatari ~Yuusha wo Taosu Tameni Maou ni Shoukansaremashita~', 'url': 'https://www.novels.pl/novel/Ankoku-Kishi-Monogatari-Yuusha-wo-Taosu-Tameni-Maou-ni-Shoukansaremashita', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/Shinwa-Densetsu-no-Eiyuu-no-Isekaitan', 'info': ''}, {'title': 'Shinwa Densetsu no Eiyuu no Isekaitan', 'url': 'https://www.novels.pl/novel/Shinwa-Densetsu-no-Eiyuu-no-Isekaitan', 'info': ''}, {'title': '', 'url': 'https://www.novels.pl/novel/Breakthrough-with-the-Forbidden-Master', 'info': ''}, {'title': 'Breakthrough with the Forbidden Master', 'url': 'https://www.novels.pl/novel/Breakthrough-with-the-Forbidden-Master', 'info': ''}]
2021-07-28 20:47:37,025 [INFO] (lncrawl.core.novel_search)
64 results from https://novels.pl/
2021-07-28 20:47:37,066 [DEBUG] (urllib3.connectionpool)
https://www.wuxiaworld.com:443 "GET /api/novels/search?query=hero&count=5 HTTP/1.1" 200 None
2021-07-28 20:47:37,077 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Heroes Shed No Tears', 'url': 'https://www.wuxiaworld.com/novel/heros-shed-no-tears'}]
2021-07-28 20:47:37,078 [INFO] (lncrawl.core.novel_search)
1 results from https://www.wuxiaworld.com/
2021-07-28 20:47:37,115 [DEBUG] (urllib3.connectionpool)
https://wuxiaworld.io:443 "GET /search.ajax?type=&query=hero HTTP/1.1" 301 None
2021-07-28 20:47:37,144 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): wuxiaworld.name:443
2021-07-28 20:47:37,165 [DEBUG] (urllib3.connectionpool)
https://wuxiaworld.live:443 "GET /search.ajax?type=&query=hero HTTP/1.1" 301 None
2021-07-28 20:47:37,190 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): wuxiaworld.name:443
2021-07-28 20:47:37,231 [DEBUG] (lncrawl.core.novel_search)
[{'url': 'http://wspadancewichita.com/the-hero-returns.html', 'title': 'The Hero Returns', 'info': 'last chapter : Chapter 383'}, {'url': 'http://wspadancewichita.com/heroes-of-marvel.html', 'title': 'Heroes of Marvel', 'info': 'last chapter : CHAPTER 667 VISI'}, {'url': 'http://wspadancewichita.com/nidome-no-yuusha.html', 'title': 'Nidome no Yuusha', 'info': 'last chapter : Chapter 202: A forcible end to the stalemate [Continuation]'}, {'url': 'http://wspadancewichita.com/my-sister-the-heroine-and-i-the-villainess.html', 'title': 'My Sister the Heroine, and I the Villainess', 'info': 'last chapter : Chapter 115'}, {'url': 'http://wspadancewichita.com/i-was-kicked-out-of-the-heros-party-because-i-wasnt-a-true-companion-so-i-decided-to-have-a-slow-life-at-the-frontier.html', 'title': "I Was Kicked out of the Hero's Party Because I Wasn't a True Companion so I Decided to Have a Slow Life at the Frontier", 'info': 'last chapter : Chapter 163 - Gideon’s answer'}]
2021-07-28 20:47:37,246 [INFO] (lncrawl.core.novel_search)
5 results from http://wspadancewichita.com/
2021-07-28 20:47:37,685 [DEBUG] (urllib3.connectionpool)
https://www.wuxiaworld.co:443 "GET /search/hero/1 HTTP/1.1" 200 None
2021-07-28 20:47:38,152 [DEBUG] (root)
Searching failure for https://wondernovels.com/
2021-07-28 20:47:38,189 [DEBUG] (urllib3.connectionpool)
https://wuxiaworld.name:443 "GET /search.ajax?type=&query=hero HTTP/1.1" 200 None
2021-07-28 20:47:38,193 [DEBUG] (lncrawl.core.novel_search)
[]
2021-07-28 20:47:38,199 [INFO] (lncrawl.core.novel_search)
0 results from https://wordexcerpt.com/
2021-07-28 20:47:38,198 [DEBUG] (urllib3.connectionpool)
https://zinnovel.com:443 "GET /?s=hero&post_type=wp-manga&author=&artist=&release= HTTP/1.1" 200 None
2021-07-28 20:47:38,239 [DEBUG] (urllib3.connectionpool)
https://wuxiaworld.name:443 "GET /search.ajax?type=&query=hero HTTP/1.1" 200 None
2021-07-28 20:47:38,335 [DEBUG] (lncrawl.core.novel_search)
[{'url': 'https://www.royalroad.com/fiction/36735/the-perfect-run', 'title': 'The Perfect Run'}, {'url': 'https://www.royalroad.com/fiction/31429/cinnamon-bun', 'title': 'Cinnamon Bun'}, {'url': 'https://www.royalroad.com/fiction/15130/threadbare', 'title': 'Threadbare'}, {'url': 'https://www.royalroad.com/fiction/33378/i-became-a-biologist-in-a-fantasy-world', 'title': 'I Became a [Biologist] in a Fantasy World!'}, {'url': 'https://www.royalroad.com/fiction/41618/mark-of-the-fool-a-progression-fantasy', 'title': 'Mark of the Fool: A Progression Fantasy'}]
2021-07-28 20:47:38,337 [INFO] (lncrawl.core.novel_search)
5 results from https://www.royalroad.com/
2021-07-28 20:47:38,370 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Hero System', 'url': 'https://wuxiaworld.name/wuxia/the-hero-system', 'info': 'Latest: '}, {'title': 'Dungeon Defense', 'url': 'https://wuxiaworld.name/wuxia/dungeon-defense', 'info': 'Latest: '}, {'title': 'My Hero Academia: Reborn As Denki Kaminari', 'url': 'https://wuxiaworld.name/wuxia/my-hero-academia-reborn-as-denki-kaminari', 'info': 'Latest: '}, {'title': 'I Don’t Want To Be a Hero', 'url': 'https://wuxiaworld.name/wuxia/i-dont-want-to-be-a-hero', 'info': 'Latest: '}, {'title': 'Senior Green Tea Turned Into an Abused Heroine', 'url': 'https://wuxiaworld.name/wuxia/senior-green-tea-turned-into-an-abused-heroine', 'info': 'Latest: '}, {'title': 'Digitalization Of The World', 'url': 'https://wuxiaworld.name/wuxia/digitalization-of-the-world', 'info': 'Latest: '}, {'title': 'Ascension: Online A:O', 'url': 'https://wuxiaworld.name/wuxia/ascension-online-ao', 'info': 'Latest: '}, {'title': 'The 300 Heroes Of The Manga', 'url': 'https://wuxiaworld.name/wuxia/the-300-heroes-of-the-manga', 'info': 'Latest: '}, {'title': 'I was a Nerfed Hero in Another World', 'url': 'https://wuxiaworld.name/wuxia/i-was-a-nerfed-hero-in-another-world', 'info': 'Latest: '}, {'title': 'My World Traveling System: The Harbinger Of Death', 'url': 'https://wuxiaworld.name/wuxia/my-world-traveling-system-the-harbinger-of-death', 'info': 'Latest: '}]
2021-07-28 20:47:38,371 [INFO] (lncrawl.core.novel_search)
10 results from https://wuxiaworld.live/
2021-07-28 20:47:38,511 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Hero System', 'url': 'https://wuxiaworld.name/wuxia/the-hero-system', 'info': 'Latest: '}, {'title': 'Dungeon Defense', 'url': 'https://wuxiaworld.name/wuxia/dungeon-defense', 'info': 'Latest: '}, {'title': 'My Hero Academia: Reborn As Denki Kaminari', 'url': 'https://wuxiaworld.name/wuxia/my-hero-academia-reborn-as-denki-kaminari', 'info': 'Latest: '}, {'title': 'I Don’t Want To Be a Hero', 'url': 'https://wuxiaworld.name/wuxia/i-dont-want-to-be-a-hero', 'info': 'Latest: '}, {'title': 'Senior Green Tea Turned Into an Abused Heroine', 'url': 'https://wuxiaworld.name/wuxia/senior-green-tea-turned-into-an-abused-heroine', 'info': 'Latest: '}, {'title': 'Digitalization Of The World', 'url': 'https://wuxiaworld.name/wuxia/digitalization-of-the-world', 'info': 'Latest: '}, {'title': 'Ascension: Online A:O', 'url': 'https://wuxiaworld.name/wuxia/ascension-online-ao', 'info': 'Latest: '}, {'title': 'The 300 Heroes Of The Manga', 'url': 'https://wuxiaworld.name/wuxia/the-300-heroes-of-the-manga', 'info': 'Latest: '}, {'title': 'I was a Nerfed Hero in Another World', 'url': 'https://wuxiaworld.name/wuxia/i-was-a-nerfed-hero-in-another-world', 'info': 'Latest: '}, {'title': 'My World Traveling System: The Harbinger Of Death', 'url': 'https://wuxiaworld.name/wuxia/my-world-traveling-system-the-harbinger-of-death', 'info': 'Latest: '}]
2021-07-28 20:47:38,529 [INFO] (lncrawl.core.novel_search)
10 results from https://wuxiaworld.io/
2021-07-28 20:47:38,835 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Heroes Shed No Tears', 'url': 'http://wuxiaworld.cloud/novel/heroes-shed-no-tears', 'info': 'Latest chapter: Chapter 18: Heroes Never Die'}, {'title': 'The Laid-back Life in Another World of the Ex-Hero Candidate Who Turned out to be a Cheat from Level 2', 'url': 'http://wuxiaworld.cloud/novel/the-laid-back-life-in-another-world-of-the-ex-hero-candidate-who-turned-out-to-be-a-cheat-from-level-2', 'info': 'Latest chapter: Chapter 103'}, {'title': 'The Hero Returns', 'url': 'http://wuxiaworld.cloud/novel/the-hero-returns', 'info': 'Latest chapter: Chapter 383'}, {'title': 'Heroes of Marvel', 'url': 'http://wuxiaworld.cloud/novel/heroes-of-marvel', 'info': 'Latest chapter: CHAPTER 667 VISI'}, {'title': "I Was Kicked out of the Hero's Party Because I Wasn't a True Companion so I Decided to Have a Slow Life at the Frontier", 'url': 'http://wuxiaworld.cloud/novel/i-was-kicked-out-of-the-heros-party-because-i-wasnt-a-true-companion-so-i-decided-to-have-a-slow-life-at-the-frontier', 'info': 'Latest chapter: Chapter 163 - Gideon’s answer'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'http://wuxiaworld.cloud/novel/shift-the-side-character-heroine', 'info': 'Latest chapter: Chapter 773 (END) - The Eternal Heroine (Grand Finale)'}, {'title': "Hero? I've Long Stopped Being One", 'url': 'http://wuxiaworld.cloud/novel/hero-ive-long-stopped-being-one', 'info': 'Latest chapter: Chapter 3'}, {'title': 'My Hero', 'url': 'http://wuxiaworld.cloud/novel/my-hero', 'info': 'Latest chapter: short story (END)'}, {'title': 'Running Away From The Hero! (Remake)', 'url': 'http://wuxiaworld.cloud/novel/running-away-from-the-hero-remake', 'info': 'Latest chapter: Chapter 120'}, {'title': 'My Sister the Heroine, and I the Villainess', 'url': 'http://wuxiaworld.cloud/novel/my-sister-the-heroine-and-i-the-villainess', 'info': 'Latest chapter: Chapter 115'}]
2021-07-28 20:47:38,836 [INFO] (lncrawl.core.novel_search)
10 results from http://wuxiaworld.cloud/
2021-07-28 20:47:38,887 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Hero Of Astia', 'url': 'https://www.wuxiaworld.co/Hero-Of-Astia/', 'info': 'WebPreacher '}, {'title': 'Demon Kings Pet', 'url': 'https://www.wuxiaworld.co/Demon-Kings-Pet/', 'info': 'tinypandahero '}, {'title': 'Grave of Heroes', 'url': 'https://www.wuxiaworld.co/Grave-of-Heroes/', 'info': 'Andrew Reise '}, {'title': 'The Betrayed Golden Hero', 'url': 'https://www.wuxiaworld.co/The-Betrayed-Golden-Hero/', 'info': 'kakui999999 '}, {'title': 'The highschool hero', 'url': 'https://www.wuxiaworld.co/The-highschool-hero/', 'info': 'Beth04lol '}, {'title': 'Golden Hero', 'url': 'https://www.wuxiaworld.co/Golden-Hero/', 'info': 'Julian69 '}, {'title': 'Journey of a Hero', 'url': 'https://www.wuxiaworld.co/Journey-of-a-Hero/', 'info': 'Thousand_Blades '}, {'title': "A Hero's Journey", 'url': 'https://www.wuxiaworld.co/A-Hero-s-Journey/', 'info': 'SlyOW '}, {'title': 'Invincible System: Herofall', 'url': 'https://www.wuxiaworld.co/Invincible-System:-Herofall/', 'info': 'JohnDailies '}, {'title': 'Abyss of Silent Heroes', 'url': 'https://www.wuxiaworld.co/Abyss-of-Silent-Heroes/', 'info': 'fraulein1423 '}]
2021-07-28 20:47:38,891 [INFO] (lncrawl.core.novel_search)
10 results from https://www.wuxiaworld.co/
2021-07-28 20:47:39,371 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'I Have Become The Heroes’ Rival', 'url': 'https://woopread.com/series/i-have-become-the-heroes-rival/', 'info': 'Chapter 69 | Rating: 4.7'}, {'title': 'Kill the Hero', 'url': 'https://woopread.com/series/kill-the-hero/', 'info': 'Chapter 275 | Rating: 4.5'}, {'title': 'I’m a Villainess but So Popular', 'url': 'https://woopread.com/series/im-a-villainess-but-so-popular/', 'info': 'Chapter 166 | Rating: 4.7'}, {'title': 'Crown of Thorns', 'url': 'https://woopread.com/series/crown-of-thorns/', 'info': "Chapter 83 - The Warrior's story | Rating: 4.8"}, {'title': 'I Raised an Obsessive Servant', 'url': 'https://woopread.com/series/i-raised-an-obsessive-servant/', 'info': 'Chapter 27 | Rating: 4.7'}, {'title': 'I Became the Wife of a Monstrous Crown Prince', 'url': 'https://woopread.com/series/i-became-the-wife-of-the-monstrous-crown-prince/', 'info': 'Side Story 6 | Rating: 4.7'}, {'title': 'The Villain’s Sister Suffers Today', 'url': 'https://woopread.com/series/the-villains-sister-suffers-today/', 'info': 'Side Story 41 | Rating: 4.6'}, {'title': 'I Met the Male Lead in Prison', 'url': 'https://woopread.com/series/i-met-the-male-lead-in-prison/', 'info': 'Chapter 138 | Rating: 4.6'}]
2021-07-28 20:47:39,374 [INFO] (lncrawl.core.novel_search)
8 results from https://woopread.com/
2021-07-28 20:47:39,962 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Trash of the Count’s Family', 'url': 'https://wbnovel.com/novel/trash-of-the-counts-family/', 'info': 'Chapter 412 | Rating: 4.6'}, {'title': 'White-Robed Chief', 'url': 'https://wbnovel.com/novel/white-robed-chief/', 'info': 'Chapter 1215 | Rating: 4.7'}, {'title': 'History’s Strongest Senior Brother', 'url': 'https://wbnovel.com/novel/historys-strongest-senior-brother/', 'info': 'Chapter 650 | Rating: 5'}, {'title': 'VRMMO: The Unrivaled', 'url': 'https://wbnovel.com/novel/vrmmo-the-unrivaled/', 'info': 'Chapter 850 | Rating: 5'}, {'title': 'Dragon Poor', 'url': 'https://wbnovel.com/novel/dragon-poor/', 'info': 'Chapter 166 | Rating: 4'}, {'title': 'Rebuild World', 'url': 'https://wbnovel.com/novel/rebuild-world/', 'info': 'Chapter 151 | Rating: 4.8'}, {'title': 'I’m Actually a Cultivation Bigshot', 'url': 'https://wbnovel.com/novel/im-actually-a-cultivation-bigshot/', 'info': 'Chapter 389 | Rating: 5'}, {'title': 'Martial God Space', 'url': 'https://wbnovel.com/novel/martial-god-space/', 'info': 'Chapter 800 | Rating: 4.5'}, {'title': 'Magic Apprentice', 'url': 'https://wbnovel.com/novel/magic-apprentice/', 'info': 'Chapter 21.5 | Rating: 5'}, {'title': 'Keyboard Immortal', 'url': 'https://wbnovel.com/novel/keyboard-immortal/', 'info': 'Chapter 484 | Rating: 5'}, {'title': 'The Sovereign’s Ascension wbnovel', 'url': 'https://wbnovel.com/novel/the-sovereigns-ascension-wbnovel/', 'info': 'Chapter 530 | Rating: 5'}, {'title': 'Magic Industry Empire', 'url': 'https://wbnovel.com/novel/magic-industry-empire/', 'info': 'V 6 Chapter 5 | Rating: 5'}, {'title': 'Genius Detective', 'url': 'https://wbnovel.com/novel/genius-detective/', 'info': 'Chapter 742 | Rating: 4.7'}, {'title': 'Genius Daddy in the City', 'url': 'https://wbnovel.com/novel/genius-daddy-in-the-city/', 'info': 'Chapter 943 | Rating: 4'}, {'title': 'The Genius System Without Equal', 'url': 'https://wbnovel.com/novel/the-genius-system-without-equal/', 'info': 'Chapter 831 | Rating: 4.9'}, {'title': 'Scholar’s Advanced Technological System', 'url': 'https://wbnovel.com/novel/scholars-advanced-technological-system/', 'info': 'Chapter 1651 | Rating: 4.5'}, {'title': 'Fury Towards The Burning Heaven', 'url': 'https://wbnovel.com/novel/fury-towards-the-burning-heaven/', 'info': 'Chapter 1700 | Rating: 4.9'}, {'title': 'Worlds’ Apocalypse Online', 'url': 'https://wbnovel.com/novel/worlds-apocalypse-online/', 'info': 'Chapter 1454 | Rating: 4.2'}, {'title': 'Super Gene', 'url': 'https://wbnovel.com/novel/super-gene/', 'info': 'Chapter 2997 | Rating: 5'}, {'title': 'The Daily Life of the Immortal King', 'url': 'https://wbnovel.com/novel/the-daily-life-of-the-immortal-king/', 'info': 'Chapter 880 | Rating: 5'}]
2021-07-28 20:47:39,963 [INFO] (lncrawl.core.novel_search)
20 results from https://wbnovel.com/
2021-07-28 20:47:40,022 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'Deity Hero: Me! Gaining Disciples Makes Me Stronger!', 'url': 'https://vipnovel.com/vipnovel/deity-hero-me-gaining-disciples-makes-me-stronger/', 'info': 'Chapter 191 | Rating: 3.9'}, {'title': 'Immortal Hero: I Can See the Success Rate', 'url': 'https://vipnovel.com/vipnovel/immortal-hero-i-can-see-the-success-rate/', 'info': 'Chapter 121 | Rating: 3.3'}, {'title': 'Immortal Hero: I Can Replicate Talents', 'url': 'https://vipnovel.com/vipnovel/immortal-hero-i-can-replicate-talents/', 'info': 'Chapter 43 | Rating: 3.7'}, {'title': 'The Hero Returns', 'url': 'https://vipnovel.com/vipnovel/the-hero-returns-novel/', 'info': 'Chapter 383 | Rating: 4.1'}, {'title': 'I Like Your Pheromones', 'url': 'https://vipnovel.com/vipnovel/i-like-your-pheromones/', 'info': 'Chapter 5 | Rating: 4'}, {'title': 'From The Strongest Job of Dragon Knight, To The Beginner Job Carrier, Somehow, The Heroes are Depending on Me', 'url': 'https://vipnovel.com/vipnovel/from-the-strongest-job-of-dragon-knight-to-the-beginner-job-carrier-somehow-the-heroes-are-depending-on-me/', 'info': 'Volume 5 Chapter 2 | Rating: 3.7'}, {'title': 'Running Away From The Hero! (Remake)', 'url': 'https://vipnovel.com/vipnovel/running-away-from-the-hero-remake/', 'info': 'Chapter 120 | Rating: 4'}, {'title': 'The Coming Heroine: The Only Princess', 'url': 'https://vipnovel.com/vipnovel/the-coming-heroine-the-only-princess/', 'info': 'Chapter 268 | Rating: 4'}, {'title': 'The Taming of the Ruffian Hero', 'url': 'https://vipnovel.com/vipnovel/the-taming-of-the-ruffian-hero/', 'info': 'Chapter 230 | Rating: 3.8'}, {'title': 'My Hero', 'url': 'https://vipnovel.com/vipnovel/my-hero/', 'info': 'My Hero | Rating: 4'}, {'title': 'FFF-Class Trashero', 'url': 'https://vipnovel.com/vipnovel/fff-class-trashero/', 'info': 'Chapter 99 | Rating: 3.7'}, {'title': 'I Became the Hero’s Bride!', 'url': 'https://vipnovel.com/vipnovel/i-became-the-heros-bride/', 'info': 'Chapter 35(End) | Rating: 3.7'}, {'title': 'My Dungeons Are Popular', 'url': 'https://vipnovel.com/vipnovel/my-dungeons-are-popular/', 'info': 'Chapter 91 | Rating: 4.3'}, {'title': 'My Fusion System: Fusing a Thousand Chickens at the Start', 'url': 'https://vipnovel.com/vipnovel/my-fusion-system-fusing-a-thousand-chickens-at-the-start/', 'info': 'Chapter 200 | Rating: 3.8'}, {'title': 'Starting With 3 S-Class Talents', 'url': 'https://vipnovel.com/vipnovel/starting-with-3-s-class-talents/', 'info': 'Chapter 193 | Rating: 3.1'}, {'title': 'I Experienced an SSS Encryption', 'url': 'https://vipnovel.com/vipnovel/i-experienced-an-sss-encryption/', 'info': 'Chapter 132 | Rating: 3.8'}, {'title': 'Pet Beasts of the World: Hundred-Fold Multiplier System', 'url': 'https://vipnovel.com/vipnovel/pet-beasts-of-the-world-hundred-fold-multiplier-system/', 'info': 'Chapter 181 | Rating: 3.7'}, {'title': 'Binding to Geniuses To Become Stronger', 'url': 'https://vipnovel.com/vipnovel/binding-to-geniuses-to-become-stronger/', 'info': 'Chapter 161 | Rating: 4.2'}, {'title': 'Midnight Bookstore', 'url': 'https://vipnovel.com/vipnovel/midnight-bookstore/', 'info': 'Chapter 435 | Rating: 3.2'}, {'title': 'Supreme Crazy Wife', 'url': 'https://vipnovel.com/vipnovel/supreme-crazy-wife/', 'info': 'Chapter 221 | Rating: 4.1'}]
2021-07-28 20:47:40,040 [INFO] (lncrawl.core.novel_search)
20 results from https://vipnovel.com/
2021-07-28 20:47:40,168 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Hero Returns', 'url': 'https://readnovelz.net/read/the-hero-returns/', 'info': 'Chapter 383 | Rating: 4.8'}, {'title': 'Shift! The Side-Character Heroine', 'url': 'https://readnovelz.net/read/shift-the-side-character-heroine/', 'info': 'Chapter 773 (END) - The Eternal Heroine (Grand Finale) | Rating: 4.8'}, {'title': 'I Was Kicked out of the Hero’s Party Because I Wasn’t a True Companion so I Decided to Have a Slow Life at the Frontier', 'url': 'https://readnovelz.net/read/i-was-kicked-out-of-the-heros-party-because-i-wasnt-a-true-companion-so-i-decided-to-have-a-slow-life-at-the-frontier/', 'info': 'Chapter 163 - Gideon’s answer | Rating: 4.8'}, {'title': 'Heroes of Marvel', 'url': 'https://readnovelz.net/read/heroes-of-marvel/', 'info': 'CHAPTER 667 VISI | Rating: 4.8'}, {'title': 'Death Is The Only Ending For The Villain', 'url': 'https://readnovelz.net/read/death-is-the-only-ending-for-the-villain/', 'info': 'Special Chapters 8 | Rating: 4.8'}, {'title': 'Trash of the Count’s Family', 'url': 'https://readnovelz.net/read/trash-of-the-counts-family/', 'info': 'Chapter 687: Promise 4 | Rating: 4.8'}, {'title': 'Oukoku e Tsuzuku Michi', 'url': 'https://readnovelz.net/read/oukoku-e-tsuzuku-michi/', 'info': 'Chapter 526: Slapstick Side Story 1 Pipi | Rating: 4.8'}, {'title': '108 Maidens of Destiny', 'url': 'https://readnovelz.net/read/108-maidens-of-destiny/', 'info': 'Prologue | Rating: 4.8'}, {'title': 'Tomb Raider King', 'url': 'https://readnovelz.net/read/tomb-raider-king-pi2/', 'info': 'Chapter 415: Epilogue 6 | Rating: 4.8'}, {'title': 'The Evolution of a Goblin to the Peak', 'url': 'https://readnovelz.net/read/the-evolution-of-a-goblin-to-the-peak/', 'info': 'Chapter 383 - [Dark Shooting Ray] | Rating: 4.8'}, {'title': 'Medical Master', 'url': 'https://readnovelz.net/read/medical-master/', 'info': 'Chapter 827 - I Don’t Want to Drink Urine | Rating: 4.8'}, {'title': 'The Male Lead’s Villainess Fiancée', 'url': 'https://readnovelz.net/read/the-male-leads-villainess-fiancee/', 'info': 'Chapter 186(END) - Just Like Always [END] | Rating: 4.8'}, {'title': 'Professional Body Double', 'url': 'https://readnovelz.net/read/professional-body-double/', 'info': 'Epilogue - The Husbands’ Sweet Days (M) – End | Rating: 5'}, {'title': 'Battle Frenzy', 'url': 'https://readnovelz.net/read/battle-frenzy/', 'info': 'Chapter 1212 - My Most Beloved Friend | Rating: 4.8'}, {'title': 'Once Upon A Time, There Was A Spirit Sword Mountain', 'url': 'https://readnovelz.net/read/once-upon-a-time-there-was-a-spirit-sword-mountain/', 'info': 'Chapter 850 (END) - Goodbye | Rating: 4.8'}, {'title': 'Martial Arts Master', 'url': 'https://readnovelz.net/read/martial-arts-master/', 'info': 'Chapter 753 - A Late Interview | Rating: 4.8'}, {'title': 'I Am Supreme', 'url': 'https://readnovelz.net/read/i-am-supreme/', 'info': 'Chapter 1088 - I Can’t Believe I Was Knocked Unconscious! | Rating: 4.8'}, {'title': 'I Reincarnated For Nothing', 'url': 'https://readnovelz.net/read/i-reincarnated-for-nothing/', 'info': 'Chapter 203 (END) - Epilogue | Rating: 4.8'}, {'title': 'A Step into the Past', 'url': 'https://readnovelz.net/read/a-step-into-the-past/', 'info': 'Volume 25 Epilogue | Rating: 4.8'}, {'title': 'Advent of the Archmage', 'url': 'https://readnovelz.net/read/advent-of-the-archmage/', 'info': 'Chapter 726 (END) - Ultimate True God, the Pioneer of the Era of Gods (Ending) | Rating: 4.8'}, {'title': 'The Sage Who Transcended Samsara', 'url': 'https://readnovelz.net/read/the-sage-who-transcended-samsara/', 'info': 'Chapter 1204 - Meng Qi, A Teacher By Worthy Example | Rating: 4.8'}, {'title': 'Godly Stay-Home Dad', 'url': 'https://readnovelz.net/read/godly-stay-home-dad/', 'info': 'Chapter 991 - Li Qingyan | Rating: 4.8'}, {'title': 'White-Robed Chief', 'url': 'https://readnovelz.net/read/white-robed-chief/', 'info': 'Chapter 1215 - Breaking Formation | Rating: 4.8'}, {'title': 'Kumo Desu ga, Nani ka?', 'url': 'https://readnovelz.net/read/kumo-desu-ga-nani-ka/', 'info': 'tipsy | Rating: 4.8'}, {'title': 'Immortal and Martial Dual Cultivation', 'url': 'https://readnovelz.net/read/immortal-and-martial-dual-cultivation/', 'info': 'Chapter 2380 Epilogue 5 : How Fragrant Was This Flower? | Rating: 4.8'}, {'title': 'God Emperor', 'url': 'https://readnovelz.net/read/god-emperor/', 'info': 'Chapter 2054 - There Is No Escape | Rating: 4.8'}, {'title': 'To Be a Power in the Shadows!', 'url': 'https://readnovelz.net/read/to-be-a-power-in-the-shadows/', 'info': 'Chapter 203 - Seems Like Never Coming Back | Rating: 4.8'}, {'title': 'Soaring the Heavens', 'url': 'https://readnovelz.net/read/soaring-the-heavens/', 'info': 'Chapter 532 - The New Employee | Rating: 4.8'}, {'title': 'Dungeon Defense', 'url': 'https://readnovelz.net/read/dungeon-defense/', 'info': 'Chapter 43 (END) - Volume 5 | Rating: 4.8'}, {'title': 'World Reformation Activities of the Dark God — Loving Humans So Much, I Reincarnated in One —', 'url': 'https://readnovelz.net/read/world-reformation-activities-of-the-dark-god-loving-humans-so-much-i-reincarnated-in-one/', 'info': 'Chapter 423 (END) - Afterword | Rating: 4.8'}, {'title': 'Profane Prince of Domination', 'url': 'https://readnovelz.net/read/profane-prince-of-domination/', 'info': 'Chapter 579: Side Chapter IV: Spatio-Temporal Netori | Rating: 4.8'}, {'title': 'Sage Monarch', 'url': 'https://readnovelz.net/read/sage-monarch/', 'info': 'Chapter 1601: It Ends | Rating: 4.8'}, {'title': 'The Villain’s Redemption', 'url': 'https://readnovelz.net/read/the-villains-redemption/', 'info': 'Chapter 292 - Guards! | Rating: 4.8'}, {'title': 'Monster Factory', 'url': 'https://readnovelz.net/read/monster-factory/', 'info': 'Chapter 478: Being pressed on the ground and rubbing | Rating: 4.8'}, {'title': 'Everybody is Kung Fu Fighting, While I Started a Farm', 'url': 'https://readnovelz.net/read/everybody-is-kung-fu-fighting-while-i-started-a-farm/', 'info': 'Chapter 553 - Holy Herbs | Rating: 4.8'}, {'title': 'Imperial Commander: His Pretty Wife Is Spoiled Rotten', 'url': 'https://readnovelz.net/read/imperial-commander-his-pretty-wife-is-spoiled-rotten/', 'info': 'Chapter 781 - It Can Be Terrifying When a Soft-Hearted Tyrant Becomes a Violent | Rating: 4.8'}, {'title': 'Oh My God! Earthlings are Insane!', 'url': 'https://readnovelz.net/read/oh-my-god-earthlings-are-insane/', 'info': 'Chapter 606 - Silver-Eyed Boy | Rating: 4.8'}, {'title': 'Transmigrating: I Married the Male Protagonist’s Uncle', 'url': 'https://readnovelz.net/read/transmigrating-i-married-the-male-protagonists-uncle/', 'info': 'Chapter 675 - Suddenly Broken | Rating: 4.8'}, {'title': 'I’m the King Of Technology', 'url': 'https://readnovelz.net/read/im-the-king-of-technology/', 'info': 'Chapter 1104 - Black Magic | Rating: 4.8'}, {'title': 'Super Gene Optimization Fluid', 'url': 'https://readnovelz.net/read/super-gene-optimization-fluid/', 'info': 'Chapter 624 - Heartless and Gluttonous | Rating: 4.8'}, {'title': 'My Disciples Are All Villains', 'url': 'https://readnovelz.net/read/my-disciples-are-all-villains/', 'info': 'Chapter 777 - Special Karmic Fire | Rating: 4.8'}, {'title': 'Letting Loose After Marrying A Tycoon', 'url': 'https://readnovelz.net/read/letting-loose-after-marrying-a-tycoon/', 'info': 'Chapter 498 - Shameless and Flirty | Rating: 4.8'}, {'title': 'Infinite Mana In The Apocalypse', 'url': 'https://readnovelz.net/read/infinite-mana-in-the-apocalypse/', 'info': 'Chapter 877 - DICTATORIAL! I | Rating: 4.8'}, {'title': 'I Have A Super USB Drive', 'url': 'https://readnovelz.net/read/i-have-a-super-usb-drive/', 'info': 'Chapter 615: Ominous Signs | Rating: 4.8'}, {'title': 'I Am Really Not The Son of Providence', 'url': 'https://readnovelz.net/read/i-am-really-not-the-son-of-providence/', 'info': 'Chapter 503: Three Thearchs At Once! | Rating: 4.8'}, {'title': 'Fey Evolution Merchant', 'url': 'https://readnovelz.net/read/fey-evolution-merchant/', 'info': 'Chapter 516: The Insect Queen’s Metamorphosis and the Two Sacred Source Lifeforms | Rating: 4.8'}, {'title': 'Kuma Kuma Kuma Bear', 'url': 'https://readnovelz.net/read/kuma-kuma-kuma-bear/', 'info': 'Kuma Short Stories 4 | Rating: 4.8'}, {'title': 'Rebuild World', 'url': 'https://readnovelz.net/read/rebuild-world/', 'info': 'Chapter 147 | Rating: 4.8'}, {'title': 'My Father in Law is Lu Bu', 'url': 'https://readnovelz.net/read/my-father-in-law-is-lu-bu/', 'info': 'Chapter 480 | Rating: 4.8'}, {'title': 'Chrysalis', 'url': 'https://readnovelz.net/read/chrysalis/', 'info': 'Chapter 799 - Discussions With Royalty | Rating: 4.8'}, {'title': 'Cultivation Online', 'url': 'https://readnovelz.net/read/cultivation-online/', 'info': 'Chapter 418 Entering the Treasure Room | Rating: 4.8'}, {'title': 'Absolute Great Teacher', 'url': 'https://readnovelz.net/read/absolute-great-teacher/', 'info': 'Chapter 744: Bai Hao, You’re Really Useless! | Rating: 4.8'}, {'title': 'I’m Cultivating Immortality While Everyone Else Practices Martial Arts', 'url': 'https://readnovelz.net/read/im-cultivating-immortality-while-everyone-else-practices-martial-arts/', 'info': 'Chapter 246 - Illusion Array! | Rating: 4.8'}]
2021-07-28 20:47:40,169 [INFO] (lncrawl.core.novel_search)
53 results from https://readnovelz.net/
2021-07-28 20:47:40,268 [DEBUG] (lncrawl.core.novel_search)
[{'title': 'The Hero Proposed to Me', 'url': 'https://zinnovel.com/manga/the-hero-proposed-to-me/', 'info': 'Chapter 16.2 | Rating: 5'}, {'title': 'Immortal Hero: I Can See the Success Rate', 'url': 'https://zinnovel.com/manga/immortal-hero-i-can-see-the-success-rate/', 'info': 'Chapter 120 | Rating: 5'}, {'title': 'FFF-Class Trashero', 'url': 'https://zinnovel.com/manga/fffclass-trashero/', 'info': 'Chapter 120 | Rating: 5'}, {'title': 'The Hero Returns', 'url': 'https://zinnovel.com/manga/the-hero-returns/', 'info': 'Chapter 380 | Rating: 4.5'}, {'title': 'Heroes of Marvel', 'url': 'https://zinnovel.com/manga/heroes-of-marvel/', 'info': 'CHAPTER 657 RECOVERY | Rating: 5'}, {'title': 'I Have Become The Hero’s Rival', 'url': 'https://zinnovel.com/manga/i-have-become-the-heros-rival/', 'info': 'Chapter 32 | Rating: 3.9'}, {'title': 'My Lady, Please Become My Heroine!', 'url': 'https://zinnovel.com/manga/my-lady-please-become-my-heroine/', 'info': 'Chapter 13 | Rating: 4.5'}, {'title': 'Even Though I’m the Villainess, I’ll Become the Heroine!', 'url': 'https://zinnovel.com/manga/even-though-im-the-villainess-ill-become-the-heroine/', 'info': 'Chapter 3 | Rating: 4.3'}, {'title': 'To You Who Never Loved Me', 'url': 'https://zinnovel.com/manga/to-you-who-never-loved-me/', 'info': 'Chapter 12 | Rating: 4'}, {'title': 'The Maid Who Became a Knight', 'url': 'https://zinnovel.com/manga/the-maid-who-became-a-knight/', 'info': 'Chapter 117 | Rating: 5'}, {'title': 'The Blackened Second Male Lead’s Wife', 'url': 'https://zinnovel.com/manga/the-blackened-second-male-leads-wife/', 'info': 'Chapter 29 | Rating: 4.2'}, {'title': 'The Villainess Is Shy In Receiving Affection', 'url': 'https://zinnovel.com/manga/the-villainess-is-shy-in-receiving-affection/', 'info': 'Chapter 5 | Rating: 4.6'}, {'title': 'World of Cultivation', 'url': 'https://zinnovel.com/manga/world-of-cultivation/', 'info': 'hapter Eight Hundred and Fifty Four – Qing Xiao | Rating: 0'}, {'title': 'The Mech Touch', 'url': 'https://zinnovel.com/manga/the-mech-touch/', 'info': 'Chapter 2790 | Rating: 4'}, {'title': 'Raising a Fox Spirit in My Home', 'url': 'https://zinnovel.com/manga/raising-a-fox-spirit-in-my-home/', 'info': 'Chapter 666 | Rating: 0'}]
2021-07-28 20:47:40,268 [INFO] (lncrawl.core.novel_search)
15 results from https://zinnovel.com/
2021-07-28 20:47:52,528 [DEBUG] (urllib3.connectionpool)
https://novelextra.com:443 "GET /search?keyword=hero HTTP/1.1" 522 None
2021-07-28 20:47:52,533 [DEBUG] (root)
Searching failure for https://novelextra.com/
Traceback (most recent call last):
File "/data/data/com.termux/files/usr/bin/lncrawl", line 8, in
Tested with version 2.27.5 just now and issue is gone. Novel search went just fine. 👍
Describe the bug
When I ran lncrawl from Termux in my Samsung S20FE it came up with error after searching for a novel title. Tried reinstalling older versions but still have same error.
Let us know
Where did you find this bug? PIP
What is your novel URL? Didn't use URL, just search for a novel title using the word hero
If you are using PIP / EXE, what is your APP version ? 2.27.4 2.26.4
If you are using PIP / EXE, what is your operating system ?
Android 11