Scraping tropes of a certain area only

DonaldTsang commented 3 years ago

Usecase: Trying to compare these three mediums.

Things that have to be done:

Major problems to tackle:

Reference to other efforts:

JJ commented 3 years ago

This would be kinda interesting. Probably easier to scrape everything, and then filter. Thanks for the suggestion!

DonaldTsang commented 3 years ago

Hope that this can be made simply by "smelling" the button bar, and filtering out main media vs characters vs tearjerker vs trivia vs ymmv parts.

JJ commented 3 years ago

Does it change depending on the area?

DonaldTsang commented 3 years ago

keep an eye on <ul class="subpage-links"> since that is constant

JJ commented 3 years ago

OK, I'll take a look.

BradKML commented 3 years ago

This can be turned into a knowledge graph, but that is a field for another time.

rhgarcia / tropescraper