Open jtara1 opened 4 years ago
I'm unsure why you need the data elements written to stdout. Can you explain this need?
In the meantime, I recently started putting together a detailed Newspaper3k usage document that I'm publicly sharing. This document is available here: https://github.com/johnbumgarner/newspaper3_usage_overview. It contains details on how to write article elements to DataFrames, CSV and JSON files.
P.S. this document is a work in process, so more information will be added.
My personal use of this right now is in another scraping project.
One example of cli being useful is just to download and save html or text of an article for reading later offline. For small use cases like this, I could just make a python script to do this anyways.
Thanks for the info. Did you note the examples that I provided in my github repo to save data elements in multiple formats?
Yes, it can help give me a jump-start, thanks.
Great. LMK if you need any help, because I'm interested in improving my usage document.
That'd be nice to be able to get the article text to stdout. It could look like
or have a
--format json
option and include all parsed metadata on the article in a json object. shjq
should make it easy enough to process part(s) parsed from stdout anyways.