search

anthonyw12123 / 4chanwebscraper

A primitive web scraper using Python.
MIT License
0 stars 0 forks source link

Specify the destination folder (and maybe make it remember?) #18

Open anthonyw12123 opened 8 years ago

anthonyw12123 commented 8 years ago

It would be great if the script could remember, or at least accept, a designation of the target folder to work in.

cdsimpkins commented 8 years ago

for the remembering, look up pickling or best practices around a settings.py

cdsimpkins commented 8 years ago

I would like to alter my suggestion and offer up JSON as a storage medium. it's open and more portable than pickling, the storage overhead difference is negligible, and it's also supported in python as a default package.

anthonyw12123 commented 8 years ago

Then do that! It'll be my opportunity to learn Json On Wed, Sep 21, 2016 at 8:16 AM Carl notifications@github.com wrote:

I would like to alter my suggestion and offer up JSON as a storage medium. it's open and more portable than pickling, the storage overhead difference is negligible, and it's also supported in python as a default package.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/anthonyw12123/4chanwebscraper/issues/18#issuecomment-248593992, or mute the thread https://github.com/notifications/unsubscribe-auth/AD8MB-tAYgoB7R0fmM8ba4YvsAqISSgpks5qsSAygaJpZM4KCXSg .

anthonyw12123 commented 8 years ago

The option to supply a destination folder is now included in 1.1