search

driscoll42 / ebayMarketAnalyzer

Scrape all eBay sold listings to determine average/median pricing, plot listings over time with trend lines, and extract to excel
195 stars 26 forks source link

Detect for multilistings if already scraped, if so skip #58

Closed driscoll42 closed 3 years ago

driscoll42 commented 3 years ago

Is your feature request related to a problem? Please describe. Right now when scraping, if a multilisting is encountered it checks it every time without skipping it because the code is unsure if it got all the listings already.

Describe the solution you'd like Determine whether or not to skip. Logi I'm envisioning is if the following are true

  1. Is Multilisting
  2. Sold Date = Date listed on search page
  3. Sold Date is > 2 days before the most recent already scraped date in the dataframe