Create Product Web Scraper

[hackthetunnelsbot[bot]]

Description:

Create a web scraper for a site of your choosing (ex: an amazon product page, a product page from the carleton book store, etc) that scrapes and stores the information pertaining to a product within the service's database.

Add a new scraper folder within the service/src/infrastructure folder that contains any code you write relating to web scraping.

Your scraper should use the createProduct function on service/src/services/Product.ts to save the product to the database.

Acceptance Criteria:

Participant has created a web scraper for a site of there choosing that can scrape and add the scraped product data into the database.

[ajanthuthayan]

I'll take this one

[ajanthuthayan]

Run npm run scrape to add a fetched product from Amazon. By default the function is using the link: https://www.amazon.ca/Torin-ATRJH-3430T-Plastic-Multi-Function-Dividers/dp/B08DVFLT5P?pd_rd_w=qJMsk&content-id=amzn1.sym.455d47f8-77ff-46ae-8198-52ca1f6b4b00&pf_rd_p=455d47f8-77ff-46ae-8198-52ca1f6b4b00&pf_rd_r=S1TBSH9ZJTKWZ1XM5KVN&pd_rd_wg=MgIO4&pd_rd_r=d1749ae3-abaa-4e1d-87df-a0f7f6c01c84&pd_rd_i=B08DVFLT5P&psc=1&ref_=pd_bap_d_grid_rp_0_1_ec_nped_i_

You may change the link by, changing the amazon link that is passed into the addFetchedProductFromAmazon function inside of services/src/infrastructure/scraper/index.ts

[ajanthuthayan]

!review

[ajanthuthayan]

!complete

[hackthetunnelsbot[bot]]

Solved Challenges for hostility

add-404-page: 2 add-css-animation: 5 add-font-style: 1 add-footer-component: 2 add-login-page-form: 3 add-navbar-component: 3 hello-client: 1 hello-service: 1 responsive-home-page-products: 2 send-sms-with-twillio: 13 style-product-page: 3 update-favicon: 1 update-page-title: 1

[IanYau]

!approve

[hackthetunnelsbot[bot]]

Approved by @IanYau

[hackthetunnelsbot[bot]]

This challenge did not unlock any other challenges