hochschule-darmstadt / openartbrowser

Exploring the world of arts using open data
http://openartbrowser.org/
MIT License
40 stars 10 forks source link

#513: added block list for all types #514

Closed EeveesEyes closed 3 years ago

EeveesEyes commented 3 years ago

This adds a blocklist, which is applied to the crawling of all types. For artworks, the list with already crawled items is initialized with the complete blocklist, for all other types, all array-like attributes in the artwork dictionary are cleared from items on the blocklist, therefore they shouldn't be crawled. Closes #513