radiolarian / AO3Scraper

A Python scraper for getting fan fiction content and metadata from Archive of Our Own.
175 stars 56 forks source link

Get bookmarks with collections, date-times and comment threads #28

Open bianchi-dy opened 3 years ago

bianchi-dy commented 3 years ago

This is a ... New feature (non-breaking change which adds functionality)

What does this PR do? Scrapes the following information:

Author username Users who have bookmarked a work, with tags, collections, date, and time Comment threads (even the nested ones!) with users, date, and time

How was the change made? Added new functions and columns per item, i.e. get_bookmarks, get_all_comments. get_all_comments is nested as a sort of hack since it uses recursion to get to the deepest level of the comment thread.

Things I'd like feedback on Code elegance, I suppose? Or any stuff I missed in my merge

What next?