[Backend] As the Backend, I should be able to call up the Scraper service to searchGoogle - Githubissues

aetheryna / google-scraper-ruby

0 stars 0 forks source link

[Backend] As the Backend, I should be able to call up the Scraper service to searchGoogle #14

Open aetheryna opened 2 years ago

aetheryna commented 2 years ago

Why

The Backend should be able to scrape data off Google with the provided words by the CSV file.

Acceptance Criteria

Call up the background process to scrape the following data off Google.
Scraping data should do the follows:
- Number of AdWords advertisers in the top position.
- Total number of AdWords advertisers on the page.
- URLs of the AdWords advertisers in the top position.
- Number of the non-AdWords results on the page.
- URLs of the non-AdWords results on the page.
- Total number of links (all of them) on the page
- HTML code of the page/cache of the page.
Save the Scraped data into the Database to the relevant user

Resources

Background processing: https://sidekiq.org/