dipu-bd / lightnovel-crawler

Generate and download e-books from online sources.
https://pypi.org/project/lightnovel-crawler/
GNU General Public License v3.0
1.42k stars 279 forks source link

Foxaholic, Body is empty #1052

Closed watzeedzad closed 3 years ago

watzeedzad commented 3 years ago

Describe the bug

Got Body is empty error when tried to download on foxaholic

lncrawl                               
================================================================================
╭╮╱╱╱╱╱╱╭╮╱╭╮╱╱╱╱╱╱╱╱╱╱╱╱╭╮╱╭━━━╮╱╱╱╱╱╱╱╱╱╭╮
┃┃╱╱╱╱╱╱┃┃╭╯╰╮╱╱╱╱╱╱╱╱╱╱╱┃┃╱┃╭━╮┃╱╱╱╱╱╱╱╱╱┃┃
┃┃╱╱╭┳━━┫╰┻╮╭╋━╮╭━━┳╮╭┳━━┫┃╱┃┃╱╰╋━┳━━┳╮╭╮╭┫┃╭━━┳━╮
┃┃╱╭╋┫╭╮┃╭╮┃┃┃╭╮┫╭╮┃╰╯┃┃━┫┃╱┃┃╱╭┫╭┫╭╮┃╰╯╰╯┃┃┃┃━┫╭╯
┃╰━╯┃┃╰╯┃┃┃┃╰┫┃┃┃╰╯┣╮╭┫┃━┫╰╮┃╰━╯┃┃┃╭╮┣╮╭╮╭┫╰┫┃━┫┃
╰━━━┻┻━╮┣╯╰┻━┻╯╰┻━━╯╰╯╰━━┻━╯╰━━━┻╯╰╯╰╯╰╯╰╯╰━┻━━┻╯
╱╱╱╱╱╭━╯┃ v2.28.3
╱╱╱╱╱╰━━╯ 🔗 https://github.com/dipu-bd/lightnovel-crawler
--------------------------------------------------------------------------------

➡ Press  Ctrl + C  to exit

? Enter novel page url or query novel: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/  
Retrieving novel info...
https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/
NOVEL: I Was Caught up in a Hero Summoning, but That World Is at Peace
9 volumes and 868 chapters found
? Enter output directory: /Users/crossbx/Desktop/lightnovel-crawler/Lightnovels/www-foxaholic-com/I Was Caught up in a Hero Summoning bu
t That World                                                                                                                            
? What to do with existing folder? Remove old folder and start fresh                                                                    
? Which chapters to download? Last 10 chapters                                                                                          
? 10 chapters selected Continue                                                                                                         
? Which output formats to create? [epub]                                                                                                
? How many files to generate? Pack everything into a single file                                                                        
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/845ex/                    
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/846/                      
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/847/
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/848/
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/849/
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/850/                      
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/851/                      
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/852/                      
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/853/                      
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/854/                      
Downloading chapters: 100%|█████████████████████████████████████████████████████████████████████████████| 10/10 [01:21<00:00,  8.12s/ch]
Processed 10 chapters
Created: I Was Caught up in a Hero Summoning but That World c859-868.epub
✨ Task completed  

? Open the output folder? Yes 

Input: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/ Type: pip3, python3 (3.9.1) Version: 2.28.3 OS: MacOS 11.5.1

watzeedzad commented 3 years ago

Detailed log

$ lncrawl -lll                                                                 
================================================================================
╭╮╱╱╱╱╱╱╭╮╱╭╮╱╱╱╱╱╱╱╱╱╱╱╱╭╮╱╭━━━╮╱╱╱╱╱╱╱╱╱╭╮
┃┃╱╱╱╱╱╱┃┃╭╯╰╮╱╱╱╱╱╱╱╱╱╱╱┃┃╱┃╭━╮┃╱╱╱╱╱╱╱╱╱┃┃
┃┃╱╱╭┳━━┫╰┻╮╭╋━╮╭━━┳╮╭┳━━┫┃╱┃┃╱╰╋━┳━━┳╮╭╮╭┫┃╭━━┳━╮
┃┃╱╭╋┫╭╮┃╭╮┃┃┃╭╮┫╭╮┃╰╯┃┃━┫┃╱┃┃╱╭┫╭┫╭╮┃╰╯╰╯┃┃┃┃━┫╭╯
┃╰━╯┃┃╰╯┃┃┃┃╰┫┃┃┃╰╯┣╮╭┫┃━┫╰╮┃╰━╯┃┃┃╭╮┣╮╭╮╭┫╰┫┃━┫┃
╰━━━┻┻━╮┣╯╰┻━┻╯╰┻━━╯╰╯╰━━┻━╯╰━━━┻╯╰╯╰╯╰╯╰╯╰━┻━━┻╯
╱╱╱╱╱╭━╯┃ v2.28.3
╱╱╱╱╱╰━━╯ 🔗 https://github.com/dipu-bd/lightnovel-crawler
--------------------------------------------------------------------------------
                          🔊 LOG LEVEL: DEBUG
--------------------------------------------------------------------------------
2021-08-29 00:37:51,527 [DEBUG] (lncrawl.core.sources)
Loading current index data from /Users/crossbx/.lncrawl/sources/_index.json
2021-08-29 00:37:51,529 [DEBUG] (lncrawl.core.sources)
Current index was already downloaded once in last 3 hours.
2021-08-29 00:37:51,529 [DEBUG] (lncrawl.core.sources)
Saving current index data to /Users/crossbx/.lncrawl/sources/_index.json
2021-08-29 00:37:51,795 [DEBUG] (lncrawl.core.sources)
Saving current index data to /Users/crossbx/.lncrawl/sources/_index.json

➡ Press  Ctrl + C  to exit

2021-08-29 00:37:51,897 [INFO] (lncrawl.core.app)
Initialized App
? Enter novel page url or query novel: https://www.foxaholic.com/novel/i-was-cau
ght-up-in-a-hero-summoning-but-that-world-is-at-peace/                          
2021-08-29 00:38:51,165 [INFO] (lncrawl.core.app)
Detected URL input
2021-08-29 00:38:51,165 [INFO] (lncrawl.core.app)
Initializing crawler for: https://www.foxaholic.com/
Retrieving novel info...
https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/
2021-08-29 00:38:51,174 [DEBUG] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/
2021-08-29 00:38:51,197 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (1): www.foxaholic.com:443
2021-08-29 00:38:52,591 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/ HTTP/1.1" 200 None
2021-08-29 00:38:52,760 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Novel title: I Was Caught up in a Hero Summoning, but That World Is at Peace
2021-08-29 00:38:52,762 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Novel cover: https://www.foxaholic.com/wp-content/uploads/2020/05/12-01-193x278.jpg
2021-08-29 00:38:52,766 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Toudai 灯台
2021-08-29 00:38:52,770 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Novel id: 42987
2021-08-29 00:38:52,770 [DEBUG] (lncrawl.core.crawler)
POST url=https://www.foxaholic.com/wp-admin/admin-ajax.php, data=action=manga_get_chapters&manga=42987, headers={'content-type': 'application/x-www-form-urlencoded; charset=UTF-8'}
2021-08-29 00:38:53,364 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "POST /wp-admin/admin-ajax.php HTTP/1.1" 200 None
NOVEL: I Was Caught up in a Hero Summoning, but That World Is at Peace
9 volumes and 868 chapters found
? Enter output directory: /Users/crossbx/Desktop/lightnovel-crawler/Lightnovels/
www-foxaholic-com/I Was Caught up in a Hero Summoning but That World            
? What to do with existing folder? Remove old folder and start fresh            
? Which chapters to download? Last 10 chapters                                  
2021-08-29 00:38:59,015 [DEBUG] (lncrawl.bots.console)
Selected chapters:
2021-08-29 00:38:59,015 [DEBUG] (lncrawl.bots.console)
[{'id': 859, 'volume': 9, 'title': '845EX - Transcendentally Fused: Alice-chan Robo', 'url': 'https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/845ex/', 'volume_title': 'Volume 9'}, {'id': 860, 'volume': 9, 'title': '846 - Rookie Adventurers and the Legendary Chivalrous Thief ⑧', 'url': 'https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/846/', 'volume_title': 'Volume 9'}, {'id': 861, 'volume': 9, 'title': '847 - Rookie Adventurers and the Legendary Chivalrous Thief ⑨', 'url': 'https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/847/', 'volume_title': 'Volume 9'}, {'id': 862, 'volume': 9, 'title': '848 - Rookie Adventurers and the Legendary Chivalrous Thief ⑩', 'url': 'https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/848/', 'volume_title': 'Volume 9'}, {'id': 863, 'volume': 9, 'title': '849 - Rookie Adventurers and the Legendary Chivalrous Thief ⑪', 'url': 'https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/849/', 'volume_title': 'Volume 9'}, {'id': 864, 'volume': 9, 'title': '850 - Rookie Adventurers and the Legendary Chivalrous Thief ⑫', 'url': 'https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/850/', 'volume_title': 'Volume 9'}, {'id': 865, 'volume': 9, 'title': "851 - Meeting the Six Kings' Executives - Ten Demons Arc ①", 'url': 'https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/851/', 'volume_title': 'Volume 9'}, {'id': 866, 'volume': 9, 'title': "852 - Meeting the Six Kings' Executives - Ten Demons Arc ②", 'url': 'https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/852/', 'volume_title': 'Volume 9'}, {'id': 867, 'volume': 9, 'title': "853 - Meeting the Six Kings' Executives - Ten Demons Arc ③", 'url': 'https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/853/', 'volume_title': 'Volume 9'}, {'id': 868, 'volume': 9, 'title': "854 - Meeting the Six Kings' Executives - Ten Demons Arc ④", 'url': 'https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/854/', 'volume_title': 'Volume 9'}]
? 10 chapters selected Continue                                                 
2021-08-29 00:39:02,581 [INFO] (lncrawl.bots.console)
10 chapters to be downloaded
? Which output formats to create? [epub]                                        
? How many files to generate? Pack everything into a single file                
2021-08-29 00:39:06,124 [DEBUG] (lncrawl.core.downloader)                       
Downloading chapter 859: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/845ex/
2021-08-29 00:39:06,124 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/845ex/
2021-08-29 00:39:06,124 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 860: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/846/
2021-08-29 00:39:06,125 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 861: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/847/
2021-08-29 00:39:06,125 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/846/
2021-08-29 00:39:06,126 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 862: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/848/
2021-08-29 00:39:06,126 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/847/
2021-08-29 00:39:06,126 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/848/
2021-08-29 00:39:06,133 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (2): www.foxaholic.com:443
2021-08-29 00:39:06,134 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (3): www.foxaholic.com:443
2021-08-29 00:39:06,135 [DEBUG] (urllib3.connectionpool)
Starting new HTTPS connection (4): www.foxaholic.com:443
2021-08-29 00:39:06,969 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/845ex/ HTTP/1.1" 200 None
2021-08-29 00:39:07,021 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:08,247 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/847/ HTTP/1.1" 200 None
2021-08-29 00:39:08,293 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:08,294 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/848/ HTTP/1.1" 200 None
2021-08-29 00:39:08,335 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:08,508 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/846/ HTTP/1.1" 200 None
2021-08-29 00:39:08,556 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:10,024 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 859: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/845ex/
2021-08-29 00:39:10,024 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/845ex/
2021-08-29 00:39:10,859 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/845ex/ HTTP/1.1" 200 None
2021-08-29 00:39:10,909 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:11,297 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 861: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/847/
2021-08-29 00:39:11,297 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/847/
2021-08-29 00:39:11,338 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 862: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/848/
2021-08-29 00:39:11,338 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/848/
2021-08-29 00:39:11,561 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 860: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/846/
2021-08-29 00:39:11,562 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/846/
2021-08-29 00:39:11,830 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/847/ HTTP/1.1" 200 None
2021-08-29 00:39:12,144 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:12,154 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/848/ HTTP/1.1" 200 None
2021-08-29 00:39:12,189 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:12,327 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/846/ HTTP/1.1" 200 None
2021-08-29 00:39:12,367 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:18,914 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 859: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/845ex/
2021-08-29 00:39:18,914 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/845ex/
2021-08-29 00:39:19,775 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/845ex/ HTTP/1.1" 200 None
2021-08-29 00:39:19,827 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:20,149 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 861: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/847/
2021-08-29 00:39:20,149 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/847/
2021-08-29 00:39:20,192 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 862: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/848/
2021-08-29 00:39:20,192 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/848/
2021-08-29 00:39:20,372 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 860: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/846/
2021-08-29 00:39:20,372 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/846/
2021-08-29 00:39:20,622 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/847/ HTTP/1.1" 200 None
2021-08-29 00:39:20,962 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:21,019 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/848/ HTTP/1.1" 200 None
2021-08-29 00:39:21,057 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:21,169 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/846/ HTTP/1.1" 200 None
2021-08-29 00:39:21,216 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:32,831 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 863: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/849/
2021-08-29 00:39:32,831 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/849/
2021-08-29 00:39:32,831 [ERROR] (lncrawl.core.downloader)
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/845ex/
2021-08-29 00:39:33,630 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/849/ HTTP/1.1" 200 None
2021-08-29 00:39:33,663 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:33,963 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 864: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/850/
2021-08-29 00:39:33,963 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/850/
2021-08-29 00:39:34,058 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 865: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/851/
2021-08-29 00:39:34,059 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/851/
2021-08-29 00:39:34,218 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 866: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/852/
2021-08-29 00:39:34,218 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/852/
2021-08-29 00:39:34,218 [ERROR] (lncrawl.core.downloader)
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/846/
2021-08-29 00:39:34,219 [ERROR] (lncrawl.core.downloader)
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/847/
2021-08-29 00:39:34,219 [ERROR] (lncrawl.core.downloader)
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/848/
2021-08-29 00:39:34,903 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/850/ HTTP/1.1" 200 None
2021-08-29 00:39:34,903 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/851/ HTTP/1.1" 200 None
2021-08-29 00:39:34,950 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/852/ HTTP/1.1" 200 None
2021-08-29 00:39:35,009 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:35,021 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:35,045 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:36,668 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 863: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/849/
2021-08-29 00:39:36,668 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/849/
2021-08-29 00:39:37,380 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/849/ HTTP/1.1" 200 None
2021-08-29 00:39:37,413 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:38,012 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 864: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/850/
2021-08-29 00:39:38,012 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/850/
2021-08-29 00:39:38,026 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 865: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/851/
2021-08-29 00:39:38,026 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/851/
2021-08-29 00:39:38,045 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 866: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/852/
2021-08-29 00:39:38,045 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/852/
2021-08-29 00:39:38,981 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/850/ HTTP/1.1" 200 None
2021-08-29 00:39:39,015 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:39,018 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/852/ HTTP/1.1" 200 None
2021-08-29 00:39:39,038 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/851/ HTTP/1.1" 200 None
2021-08-29 00:39:39,080 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:39,102 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:45,418 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 863: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/849/
2021-08-29 00:39:45,418 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/849/
2021-08-29 00:39:46,792 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/849/ HTTP/1.1" 200 None
2021-08-29 00:39:47,017 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:47,017 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 864: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/850/
2021-08-29 00:39:47,018 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/850/
2021-08-29 00:39:47,085 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 866: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/852/
2021-08-29 00:39:47,085 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/852/
2021-08-29 00:39:47,105 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 865: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/851/
2021-08-29 00:39:47,106 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/851/
2021-08-29 00:39:47,608 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/850/ HTTP/1.1" 200 None
2021-08-29 00:39:47,647 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:48,482 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/851/ HTTP/1.1" 200 None
2021-08-29 00:39:48,493 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/852/ HTTP/1.1" 200 None
2021-08-29 00:39:48,760 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:39:48,779 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:40:00,023 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 867: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/853/
2021-08-29 00:40:00,023 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/853/
2021-08-29 00:40:00,023 [ERROR] (lncrawl.core.downloader)
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/849/
2021-08-29 00:40:00,650 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 868: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/854/
2021-08-29 00:40:00,650 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/854/
2021-08-29 00:40:00,650 [ERROR] (lncrawl.core.downloader)
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/850/
2021-08-29 00:40:00,761 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/853/ HTTP/1.1" 200 None
2021-08-29 00:40:00,849 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:40:01,406 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/854/ HTTP/1.1" 200 None
2021-08-29 00:40:01,440 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:40:01,783 [ERROR] (lncrawl.core.downloader)
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/851/
2021-08-29 00:40:01,783 [ERROR] (lncrawl.core.downloader)
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/852/
2021-08-29 00:40:03,853 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 867: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/853/
2021-08-29 00:40:03,853 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/853/
2021-08-29 00:40:04,443 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 868: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/854/
2021-08-29 00:40:04,443 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/854/
2021-08-29 00:40:04,775 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/853/ HTTP/1.1" 200 None
2021-08-29 00:40:04,808 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:40:05,291 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/854/ HTTP/1.1" 200 None
2021-08-29 00:40:05,323 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:40:12,812 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 867: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/853/
2021-08-29 00:40:12,813 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/853/
2021-08-29 00:40:13,324 [DEBUG] (lncrawl.core.downloader)
Downloading chapter 868: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/854/
2021-08-29 00:40:13,324 [INFO] (f80c4a129d59dcccbf83666ed2a83200)
Visiting https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/854/
2021-08-29 00:40:14,139 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/854/ HTTP/1.1" 200 None
2021-08-29 00:40:14,173 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:40:14,484 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/853/ HTTP/1.1" 200 None
2021-08-29 00:40:14,518 [DEBUG] (lncrawl.core.downloader)
Error: ResultSet object has no attribute 'select'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?. Retrying...
2021-08-29 00:40:27,523 [ERROR] (lncrawl.core.downloader)
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/853/
2021-08-29 00:40:27,523 [ERROR] (lncrawl.core.downloader)
Body is empty: https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace/854/
Downloading chapters:   0%|                              | 0/10 [01:21<?, ?ch/s]
Processed 10 chapters
2021-08-29 00:40:27,532 [INFO] (lncrawl.core.downloader)
Downloading original cover image...
2021-08-29 00:40:27,532 [INFO] (lncrawl.core.downloader)
Downloading image: https://www.foxaholic.com/wp-content/uploads/2020/05/12-01-193x278.jpg
2021-08-29 00:40:28,824 [DEBUG] (urllib3.connectionpool)
https://www.foxaholic.com:443 "GET /wp-content/uploads/2020/05/12-01-193x278.jpg HTTP/1.1" 200 19285
2021-08-29 00:40:28,852 [DEBUG] (lncrawl.core.downloader)
Saved cover: /Users/crossbx/Desktop/lightnovel-crawler/Lightnovels/www-foxaholic-com/I Was Caught up in a Hero Summoning but That World/cover.png
2021-08-29 00:40:28,862 [INFO] (lncrawl.core.app)
Processing data for binding
2021-08-29 00:40:28,862 [DEBUG] (lncrawl.binders.epub)
Binding epub: I Was Caught up in a Hero Summoning, but That World Is at Peace c859-868
2021-08-29 00:40:28,862 [INFO] (lncrawl.binders.epub)
Creating cover: /Users/crossbx/Desktop/lightnovel-crawler/Lightnovels/www-foxaholic-com/I Was Caught up in a Hero Summoning but That World/cover.png
2021-08-29 00:40:28,862 [INFO] (lncrawl.binders.epub)
Creating intro page
2021-08-29 00:40:28,866 [DEBUG] (lncrawl.binders.epub)
Writing /Users/crossbx/Desktop/lightnovel-crawler/Lightnovels/www-foxaholic-com/I Was Caught up in a Hero Summoning but That World/epub/I Was Caught up in a Hero Summoning but That World c859-868.epub
Created: I Was Caught up in a Hero Summoning but That World c859-868.epub
2021-08-29 00:40:28,882 [INFO] (lncrawl.core.app)
Compressing output...
2021-08-29 00:40:28,882 [INFO] (lncrawl.core.app)
Not archiving single file inside /Users/crossbx/Desktop/lightnovel-crawler/Lightnovels/www-foxaholic-com/I Was Caught up in a Hero Summoning but That World/epub
2021-08-29 00:40:28,883 [INFO] (lncrawl.core.app)
Destroyed App
✨ Task completed  

? Open the output folder? No
watzeedzad commented 3 years ago

From debug, I've found out that it got valid response from foxaholic. But it seem that ResultSet function unable to find attribute "select" from text response

image

watzeedzad commented 3 years ago

Didn't sure that it is because of syntax error in variable "contents" in function download_chapter_body or not, but when I try to inspect text attribute of ResultSet it is always yield error 'invalid syntax (, line 1)'

watzeedzad commented 3 years ago

Already fixed in #1054