Open IJMacD opened 2 years ago
If the domain is not recognised and we don't have the selectors defined already could we just fallback to scraping https://www.justtherecipe.com/?
They use https://www.justtherecipe.com/extractRecipeAtUrl?url=XXX to return a complex JSON object which could be consumed.
https://www.justtherecipe.com/extractRecipeAtUrl?url=XXX
Is is more or less ethical to scrape a scraper compared to scraping the original site?
If the domain is not recognised and we don't have the selectors defined already could we just fallback to scraping https://www.justtherecipe.com/?
They use
https://www.justtherecipe.com/extractRecipeAtUrl?url=XXXto return a complex JSON object which could be consumed.Is is more or less ethical to scrape a scraper compared to scraping the original site?