Update for new website structure?

openstate / EU_whoiswho_scraper

Scrapy spider to scrape the data of people listed on the EU Whoiswho website

3 stars 2 forks source link

Update for new website structure? #2

Open danielbunn opened 3 years ago

danielbunn commented 3 years ago

The spider.py file no longer scrapes the web page correctly.

siccovansas commented 3 years ago

Hi @danielbunn, thanks for reaching out! This scraper was created 4 years ago and indeed doesn't work on the current EU Who is Who website. We currently don't have time to update this scraper though :(. Do you need the Who is Who data? You could fix this scraper. We will happily assist you in doing that if you have any questions.

danielbunn commented 3 years ago

Hi @siccovansas - I also do not have the time to work on the scraper. I was hoping for a quick solution to get about 100 names and emails, but fixing a scraper like this is beyond my expertise.