-
Plan is to store scraping results in SQL DB for now (likely cheapest option) for team leveraging.
- [x] Spin up BigQuery in our evlens project
- [x] Map out database schema
- [x] Build out function/m…
-
Something like `ray` should be a viable option to deploy multiple selenium calls at once. For the purposes of our tasks (wherein scraping locations is a separate task from scraping location-ID-specifi…
-
The theory is that we'll be able to run our scripts faster on a dedicated server with high-speed networking...we shall see!
- [ ] Create evlens GCP organization node
- [x] Parallelize location ID scr…
-
Our aim is to study and predict the pattern of flight ticket price around the year between Mumbai and Toronto which would be helpful for people looking forward to immigrating to Canada. For this our p…
-
When I run data_collection.py the chrome window opens but I get an error:
NoSuchElementException: no such element: Unable to locate element: {"method":"css selector","selector":".selected"}
(Ses…
-
thank you for the great code :)
if you dont mind, would you able to share the files below?
- indeed_jobs.csv
I was able to get other files successfully using selenium library and the file you upl…
-
That could include subscriber count / info, and logs
-
Hi,
I noticed that the data in the project failed to update, and the voting function on https://s3.us-west-2.amazonaws.com/mlnow-newyorker/captioncontest_s3.html has disappeared. BTW The New Yorker…
-
**Summary:**
The purpose of this feature request is to implement functionality for scraping messages from specified Telegram channels.
**Motivation:**
Scraping messages from Telegram channels is cruc…
-
### Describe the feature
This scraping idea can collect all data of football matches from the past 10 years of different teams in one place according to their distribution. This can be useful for peo…