Aghababaei / PhD-Seeker

Finding latest fully funded PhD positions for international students through web scraping
GNU General Public License v3.0
84 stars 11 forks source link

CLI support #4

Closed javadr closed 2 years ago

javadr commented 2 years ago

This new PR supports CLI for the phdseeker. It also depends on a new module, docopt.

Aghababaei commented 2 years ago

This new PR supports CLI for the phdseeker. It also depends on a new module, docopt.

Thank you very much @javadr! It really helps. As to the date issue on findaphd.com, I am still working on it.

javadr commented 2 years ago

You're welcome.

It seems the date is loaded by a script after loading the main HTML. There is a special module name requests_html capable of rendering the loaded webpage with a customized javascript. Looking at this module might help you.

Good Luck