medialab / hyphe

Websites crawler with built-in exploration and control web interface
http://hyphe.medialab.sciences-po.fr/demo/
GNU Affero General Public License v3.0
328 stars 59 forks source link

startpages removal broken in declare crawls ? #423

Closed boogheta closed 2 years ago

boogheta commented 2 years ago

ERROR while updating field startpages (pop [u'https://gitlab.sciences-po.fr/users/sign_out']) of WebEntity 3 (<type 'exceptions.AttributeError'>: 'NoneType' object has no attribute 'remove')

boogheta commented 2 years ago

seems to concern only startpages of entities whose crawls were declared from HyBro