search

rufusrock / scraping_tools

3 stars 1 forks source link

Skip beautiful soup? #2

Closed bramtayl closed 1 year ago

bramtayl commented 1 year ago

It looks like you're using beautiful soup in combination with the selenium html parser. I can see how beautifulsoup is a bit more convenient, but I think it would make the code simpler if you just used selenium css selectors?

rufusrock commented 1 year ago

Yeah - this one is mostly just me being lazy. BS does have easier methods for some things like traversing the HTML tree, finding_next element etc. Will work on this!