search

prncc / steam-scraper

A pair of spiders for scraping product data and reviews from Steam.
https://intoli.com/blog/steam-scraper/
79 stars 39 forks source link

Recommended column is not being filled #4

Closed MR1991 closed 6 years ago

MR1991 commented 7 years ago

Thank you for the scraper!

One note, for me it didn't properly take the recommended value, it just always gave a TRUE result. So in the items.py file I changed the following from: 

    recommended = scrapy.Field(
        input_processor=simplify_recommended,
        output_processor=TakeFirst(),
    )

To the below and now it works (again):

 recommended = scrapy.Field(
        output_processor=Compose(TakeFirst(), str_to_float)
    )
prncc commented 6 years ago

Thanks, this should be fixed now.