laughingclouds / Scrapia-World

A web scraper for scraping wuxiaworld. Written in python, using selenium and python cmd for an interactive shell experience with a command line utility to work with text along with a database to store information.
MIT License
2 stars 1 forks source link

Make it work for the new site kiddo! #4

Closed laughingclouds closed 2 years ago

laughingclouds commented 2 years ago

The site has recently been revamped. We knew it would happen :/

Make the code work for the new site.

laughingclouds commented 2 years ago

status update: I'm fairly close to making this run

For now here are a few things that work perfectly fine

  1. Opening a new shell (as long as the current_chapter table has the required field)
  2. setup function
    • installs the addons -> removes their welcome screens
    • logs in -> gets to the novel page

I haven't tested other functions/methods yet but this is huge progress

laughingclouds commented 2 years ago

status update: I decided to take a different direction with how the program will behave initially.

Notable Additions:

What more is left: