search

gugarosa / viviner

🍷 Scraps data from Vivino and collects outstanding wine-based meta-data.
GNU General Public License v3.0
52 stars 29 forks source link

Script only scrapes wines you can buy through Vivino - not all wines matching a given criterion #6

Open epistoteles opened 2 months ago

epistoteles commented 2 months ago

I just want to take the opportunity to let you and the users of this script know that it only scrapes wines that users can buy through vivino (or a vivino partner). It does not scrape wines that are on the vivino app, with ratings, metadata, images, etc, but without a possibility to buy them through vivino - even if they have a reported average price.

This means this script will only scrape a tiny percentage of the wines that are actually findable on the app - maybe 5% or so.

epistoteles commented 2 months ago

For reference: there are approx. 12.6 million wines on vivino. Each wine has an auto-incrementing ID, where the maximum is currently at 12670409:

https://www.vivino.com/US-CA/en/w/12670409

Wines with an (old) ID below 10000 got remapped to bigger IDs. All IDs between 10,000 and 12,670,409 point to valid wines.