How to transform WARC files to be a text?

Rhizome-Conifer / conifer

Collect and revisit web pages.

https://conifer.rhizome.org

Apache License 2.0

1.48k stars 120 forks source link

How to transform WARC files to be a text? #475

Open Godbother opened 6 years ago

Godbother commented 6 years ago

Excuse me, if i want to transfrom warc file to be a text,do you have any tools in the source or any apis can help me more easier to make the transformation?

despens commented 6 years ago

You can extract single resources from a warc file using the command line interface of warcio.

Godbother commented 6 years ago

oh,thank you very much. i am a Python beginner.

despens commented 6 years ago

I think we can add the option for file extraction to warcio or another tool at some point, it would be displaced in Webrecorder itself though.