-
# Description
After scraping companies on glassdoor, the application redirects back to linkedin but keeps refreshing. Fix the constant refreshing happening after scraping company
# To replicate …
-
-
We should be able to scrape "about" section from the page of an university and fill it in a new column in niche.csv file.
-
For the website profiles we scrape we need to store the profile user names in a config file.
I was previously using CSV on another project.
We could use XML, JSON, YAML, CSV or ?
-
-
- [ ] Collect webpages of Jenkins
- [ ] Build Naive Bayes Classifier to filter out unnecessary server-side webpages
-
@komizutama and I talked about this some this morning and this is mostly a placeholder to possibly attract ideas and/or collaborators (ping @davidbella discussed a few days ago! and @dmlicht in case i…
-
Thank you voldrix for fixing the script.
I don't want to be petty. But the filenames of stories pics and vids have postid_postid format now not date_postid.
-
Setup a simple express server, hosted on EC2, that performs the scraping and saving operations. These are currently performed by me on my local machine but I'd like to move them to AWS.
Ideally, s…
-
https://simonwillison.net/2020/Oct/9/git-scraping/