purpleslurple / PurpleSlurple

PurpleSlurple transcodes web pages to make them granularly accessible.
GNU General Public License v2.0
0 stars 0 forks source link

Scrapy for scraping #5

Closed purpleslurple closed 1 year ago

purpleslurple commented 3 years ago

Investigate use of Scrapy for aggregating annotations. https://docs.scrapy.org/en/latest/intro/overview.html#scrapy-at-a-glance

For hosting see also: https://www.zyte.com/scrapy-cloud/

purpleslurple commented 2 years ago

See also: https://academy.finxter.com/course/web-scraping-using-beautiful-soup-introduction/

purpleslurple commented 1 year ago

Use BeautifulSoup

purpleslurple commented 1 year ago

See above comment :)