nianeyna / ao3downloader

Utility for downloading fanfiction in bulk from the Archive of Our Own
GNU General Public License v3.0
158 stars 14 forks source link

Blacklist works that are hidden #146

Open RowanSkie opened 2 weeks ago

RowanSkie commented 2 weeks ago

Further clarification for #136.

The application checks if something is "Deleted", however, a deleted/hidden work doesn't give that error code.

This is an example:

{"link": "https://archiveofourown.org/works/47308798", "error": "'NoneType' object has no attribute 'find'", "success": false, "stacktrace": "Traceback (most recent call last):\n  File \"D:\\Applications\\ao3downloader\\ao3downloader\\ao3.py\", line 156, in download_work\n    downloaded = self.try_download(link, log, chapters)\n  File \"D:\\Applications\\ao3downloader\\ao3downloader\\ao3.py\", line 178, in try_download\n    title = parse_soup.get_title(thesoup, work_url, pattern)\n  File \"D:\\Applications\\ao3downloader\\ao3downloader\\parse_soup.py\", line 190, in get_title\n    metadata = get_work_metadata_from_work(soup, link)\n  File \"D:\\Applications\\ao3downloader\\ao3downloader\\parse_soup.py\", line 209, in get_work_metadata_from_work\n    metadata['chapters'] = get_current_chapters(soup)\n  File \"D:\\Applications\\ao3downloader\\ao3downloader\\parse_soup.py\", line 266, in get_current_chapters\n    text = (soup.find('dl', class_='stats')\nAttributeError: 'NoneType' object has no attribute 'find'\n", "timestamp": "06/30/2024, 14:00:28"}
nianeyna commented 2 weeks ago

ohhhhh I get what you're saying now, sorry, I misunderstood