crawling ingestor metadata log file

xpmethod / opensyllabus

Other

48 stars 10 forks source link

Open denten opened 10 years ago

denten commented 10 years ago

source url, date of creation, data of capture, flag?, hash hashlog

alexduryee commented 10 years ago

Current metadata file contains:

filename URL (if relevant) checksum time of creation mimetype

I'm sure I've overlooked something; should we add anything else?

denten commented 10 years ago

that looks good--astreylabs is working on a "sniffer" that will check the file type and rename the file after the checksum