search

prncc / steam-scraper

A pair of spiders for scraping product data and reviews from Steam.
https://intoli.com/blog/steam-scraper/
77 stars 39 forks source link

Price field incorrect if only DLC options listed #2

Closed ColdSunERA closed 6 years ago

ColdSunERA commented 6 years ago

In instances where a game doesn't have a price but has tons of DLC, the sum of the DLC is added as the base price for the title.

Correct approach would be to change the price = response.css('.game_purchase_price ::text').extract_first() to either verify that it's parent element isn't "dlc_purchase_action" or to verify that the hierarchy contains the class "game_area_purchase_game"

prncc commented 6 years ago

Do you have an example of a game like that? It doesn't seem to be the case for, say, http://store.steampowered.com/app/591530/Hyper_Universe/.