search

alltrust / B-Article-Scraper

Scrape multiple online articles all at once. By inputting the articles you want scraped into the input field, B-Article-Scraper will save you time from manually navigating to each article and finding what you need.
1 stars 0 forks source link

Enhance Article Scraping #9

Open sebastianserrano opened 1 year ago

sebastianserrano commented 1 year ago

Summary

Optimize structure for scraping articles which can scale to different strategies

Expected Behavior

  1. Default strategy should be simple fetch via axios
  2. Backup strategy should use cloudscraper

Acceptance Criteria

  1. Should have tests
  2. Should maintain current behavior