search

bsgreenb / Open-Textbooks

A library for scraping nearly every college bookstore in the US
MIT License
65 stars 19 forks source link

bncollege #10

Open deehill opened 7 years ago

deehill commented 7 years ago

bncollege now has implemented obfuscation, as well as dynamic javascript content generation.

simple curl/wget processes will not work.

it appears that one will need a headless browser solution -- casperjs/phantomjs/webkit/selenium+py+browser....