Check values of new fields in Crawl metadata exports

medialab / hyphe

Websites crawler with built-in exploration and control web interface

http://hyphe.medialab.sciences-po.fr/demo/

GNU Affero General Public License v3.0

328 stars 59 forks source link

Closed boogheta closed 1 year ago

boogheta commented 1 year ago

some values in the csv are "undefined" (webarchive_*) or "null" (cookies, crawl_start_date)

boogheta commented 1 year ago

closed in 20ca478c