aesuli / steam-crawler

A set of scripts that crawls STEAM website to download game reviews.
GNU General Public License v3.0
44 stars 17 forks source link

Scrap games tags #15

Open Pompiia opened 3 years ago

Pompiia commented 3 years ago

Hi!

First of all, thank you for these amazing scripts. I am currently working on a school project and I was wondering if it was possible to also scrap the games tags in the process. I suppose that the one I need to modify is the steam-review-crawler.py script, to open individual games pages according to their IDs and scrap the information desired from them, because it seems that the steam-game-crawler.py does not save the games tags data in the HTML files (the tags are available in a hovering window on a Steam shop webpage, as class="hover_tag_row"). The issue is that I'm not really familiar with scrapping in general. Do you have an idea to tackle this issue?

Thank you!