Feature request: Scrape the villager's main page for additional villager info

sungyeonu / animal-crossing-scraper

Web scraper for Animal Crossing - New Horizons data using bs4

37 stars 11 forks source link

Feature request: Scrape the villager's main page for additional villager info #19

Closed feralheart closed 4 years ago

feralheart commented 4 years ago

Suggested aditional information:

The main image
Caption under the main image
Gender (Separated from the personality)
Initial clothes
Skill
Goal
Coffee
Favorite song
Style
The text from the Appearance section
The text from the House section
The text from the Trivia section

sungyeonu commented 4 years ago

Cool Cool I like this. I assume this file will be the biggest JSON yet!

sungyeonu commented 4 years ago

scraped everything but appearance/house/trivia section

feralheart commented 4 years ago

Thank you Can you also scrape the villager's main image?

sungyeonu commented 4 years ago

Yes of course. So each villager has two images: one on the villagers list page, and one on their individual wiki page. Should they be in one list that will contain the URLs to both image or be individually named like "main_image_url" and "side_image_url"? Do you have ideas for better names?

feralheart commented 4 years ago

I think separated keys would be the best. For example "main_image_url" and "photo_gift_url" (because the image from the table is the same what they can give you when you have high friendship with them)