search

joshua-hull / Reddit-Image-Scraper

Perl script to download imaged hosted at imgur.com linked from a subreddit at reddit.com
25 stars 8 forks source link

Reddit User Scrape #9

Closed BooJen closed 11 years ago

BooJen commented 12 years ago

feature request:

Ability to scape a specific user's posts

Ability to scrape a list of users posts

Also: Any plans to turn this into a standalone executable? with persistent monitoring capabilities?

joshua-hull commented 12 years ago

Well the user/list of users would a pretty trivial thing to add. I'll look into it in the next week since my school will be on Spring Break.

The standalone executable is a little complicated. Once you start compiling you loose the ability to move between platforms. I'd have to set up a perl compiler on each of my computers, etc. If there is a real interest in it then I can look into it.

The persistant monitoring would just be a matter of running the script at a set interval. If you are on some kind of Unix based OS then you could just use cron to run it. I might look at adding it anyway when I look at the User additions.

If anyone else want to work on these in the meantime feel free to.

BooJen commented 12 years ago

Great! Looking forward to the new feature(s)!

I asked about the standalone exe since it would open up your script/app to a lot more people. Since I myself am not so computer savvy, let alone perl savvy, I had to google how to use your script. If made available, I'm sure tonnes of people would pick up your app on reddit if it was a small windows binary.

Thanks for the reply to the feature request :-)

joshua-hull commented 12 years ago

Well another issue with being a stand alone executable, other than testing on all 10,000 versions of Windows, is that I would have to restructure the way that it gets input but I already have a way I think I can do it. If you don't mind me asking, where did you find the script?

As a side note, I will add a link to instructions to how to install and use Perl on Windows to the README file to make things a little bit easier in the meantime.

BooJen commented 12 years ago

I can imagine how testing on binaries on multiple platforms can be a daunting task. If you do decide to code a windows binary please post in this thread so I get the notification lol.

Forgot how I landed on your page but I was there was a couple of links about content downloaders and I followed a couple of them out of interest and decided to give your script a try. This was one of them

http://dontbelievethebyte.blogspot.com/2011/11/modified-reddit-perl-image-scraper.html

I wanted to try out his script too but his instructions seems a little convoluted to me since I don't know the first thing about perl other than clicking the install button.

joshua-hull commented 12 years ago

Well I appreciate the offer. I don't know about posting to this specific thread but any work I do will always be here on Github.

joshua-hull commented 11 years ago

Latest push includes initial work on scraping users. See README.md for more info. Note that at this time only one user at a time will work properly. Opening a separate issue for that problem.