GregJSLow / tumblr-downloader

Automatically exported from code.google.com/p/tumblr-downloader
0 stars 0 forks source link

anyway to share changes #3

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago
i've updated the code so it'll 
1. download more than 20 images, 
2. save image in a different folder, 
3. print out the total # of posts, 
4. fix when the link already has file extension the filename will ended up with 
.jpg.jpg or .png.jpg.

Original issue reported on code.google.com by tsang...@gmail.com on 6 Feb 2012 at 8:01

Attachments:

GoogleCodeExporter commented 9 years ago
Thank you! this is exactly what I needed it to do :)

Original comment by Fres...@gmail.com on 16 Feb 2012 at 8:28

GoogleCodeExporter commented 9 years ago
Slight problem. It's naming everything (gif, png) to .jpg...

Original comment by Fres...@gmail.com on 16 Feb 2012 at 8:48

GoogleCodeExporter commented 9 years ago
I've also noticed that if there is a set of photos in a post, it's only 
grabbing the first one. I assume because the filename is the same blah(2) 
blah(3) etc...?

Original comment by Fres...@gmail.com on 16 Feb 2012 at 10:12

GoogleCodeExporter commented 9 years ago
not all the links has file extension, if it's not there, it'll just assume it's 
a jpg.  there're ways to detect the image type but it's just too much to do.  
and if one post has file with the same name, it will skip downloading it, this 
is basically a feature so that we can resume the download.  

Original comment by tsang...@gmail.com on 17 Feb 2012 at 3:13

GoogleCodeExporter commented 9 years ago
hello why this site dont work ready ?

fuckyeahtanlines

footnight

thanks

Original comment by tonymufl...@gmail.com on 15 Mar 2012 at 11:43

GoogleCodeExporter commented 9 years ago
Downloaded this but noticed a few issues - the error trapping is awful, one 
error on a file and the downloader is coded to quit...

The previously attached .jar also didn't actually resolve the duplicate 
extensions issue, so I've just let it use whatever the file extension was. 
(shouldn't be an issue as this downloader only downloads images anyway..)

The one I've attached will run through the entire group and download all the 
pictures, and this one will skip any previously downloaded images properly.

I might tweak it a little more to handle movie clips and audio files, as well 
as giving you a running list of what's been downloaded so far..

Anyhoo, give it a go, and see if it works any better.

Original comment by s...@stoo.org.uk on 4 Jun 2012 at 9:32

GoogleCodeExporter commented 9 years ago
btw, one of the other problems with the first linked .jar file, was if there 
was no images to download on the first page of the blog, the downloader would 
quit..

Original comment by s...@stoo.org.uk on 4 Jun 2012 at 9:40

GoogleCodeExporter commented 9 years ago
Thank you for incorporating the photoset feature. It's really appreciated.
One more thing I would like is the ability to tell all save images to go to one 
directory so if a popular pic is reblogged I'm not downloading it numerous 
times.
Not by default since I know a lot of people wouldn't like that, but maybe as a 
flag on the shortcut to the jar? ie "c:\tumblrdownloader.jar -\imagefolder" or 
something to force them all into one rather than individuals?

Original comment by Fres...@gmail.com on 5 Jun 2012 at 7:01

GoogleCodeExporter commented 9 years ago
[deleted comment]
GoogleCodeExporter commented 9 years ago
Could you please make an option to select what type of files are downloaded? I 
use the photos as my wallpaper. I have no need for gifs and they're rather 
large. I'd rather not waste the bandwidth if I don't have to since I don't do 
anything but delete them anyways...

Original comment by Fres...@gmail.com on 23 Jun 2012 at 6:17

GoogleCodeExporter commented 9 years ago
I'll see what I can do, but I'm not a java developer so it might take me a 
little while ;)

One thing I will do though is upload the source I'm working from, so others can 
take over if they like :)

Original comment by s...@stoo.org.uk on 5 Jul 2012 at 7:39

GoogleCodeExporter commented 9 years ago
[deleted comment]
GoogleCodeExporter commented 9 years ago
To be honest, it'd be better to just add some parameters to the existing one, 
then call it from a sh/bat script rather than having completely separate jar 
files, it makes it easier to maintain..

Anyway, here is the source I was working from, go nuts! ;)

Original comment by s...@stoo.org.uk on 7 Jul 2012 at 3:04

GoogleCodeExporter commented 9 years ago
http://i.imgur.com/R8Brn.png

Original comment by ikillb...@gmail.com on 7 Jul 2012 at 3:59

GoogleCodeExporter commented 9 years ago
when close app whet it downloading.., it continue downloading when closed, 
proccess still runing

Original comment by ikillb...@gmail.com on 7 Jul 2012 at 4:50

GoogleCodeExporter commented 9 years ago
Issue: timestamp in console

Original comment by ikillb...@gmail.com on 8 Jul 2012 at 12:02

GoogleCodeExporter commented 9 years ago
[deleted comment]
GoogleCodeExporter commented 9 years ago
[deleted comment]
GoogleCodeExporter commented 9 years ago
[deleted comment]
GoogleCodeExporter commented 9 years ago
[deleted comment]
GoogleCodeExporter commented 9 years ago
http://i.imgur.com/AnuVQ.png problem, no free space

Original comment by ikillb...@gmail.com on 22 Jul 2012 at 6:35

GoogleCodeExporter commented 9 years ago
It wasn't designed to be bullet-proof ;)

I'm flat out with other work at the moment, but I'll see if I can resolve those 
over the weekend :)

Original comment by s...@stoo.org.uk on 16 Aug 2012 at 5:57

GoogleCodeExporter commented 9 years ago
[deleted comment]
GoogleCodeExporter commented 9 years ago
I've made a few updates - runnable jar and source is attached :)

Original comment by s...@stoo.org.uk on 17 Aug 2012 at 7:40

GoogleCodeExporter commented 9 years ago
Thanks for the updates stoo! A couple of requests if you get the time. OSX 
Mountain Lion now longer allows nested folders for the screen-savers. Is there 
any way you could have all the images download to the same folder? Also, it 
would be nice if there were a plain text file, like the Accounts file, where we 
could enter a number to determine how many of the most recent images should be 
downloaded. Your efforts are appreciated. Thanks!

Original comment by brendon2...@gmail.com on 20 Aug 2012 at 11:25

GoogleCodeExporter commented 9 years ago
[deleted comment]
GoogleCodeExporter commented 9 years ago
[deleted comment]
GoogleCodeExporter commented 9 years ago
gif images are not completely download, only the first slide, the small size. 
not animated http://i.imgur.com/sysZ8.png

Original comment by ikillb...@gmail.com on 23 Aug 2012 at 9:59

GoogleCodeExporter commented 9 years ago
Bug report for the latest version. It no longer checks for existing files to 
avoid duplicates so if you run the script twice it redownloads the entire 
tumblr library.

Original comment by brendon2...@gmail.com on 4 Sep 2012 at 11:36

GoogleCodeExporter commented 9 years ago
Bugger! I thought it was taking longer to run... I'll debug and fix as soon as 
I can..

Original comment by s...@stoo.org.uk on 5 Sep 2012 at 8:05

GoogleCodeExporter commented 9 years ago
btw, I'm going to open up a new google code project and put all the code etc 
into proper source control so others can properly contribute. ( Me not being a 
java developer and all, it's probably a good idea, lol!)

Original comment by s...@stoo.org.uk on 5 Sep 2012 at 8:17

GoogleCodeExporter commented 9 years ago
Excellent work 😃!
Miserably, I have to confim that âš  it no longer checks for existing files to 
avoid duplicates, âš  gif images are not completely download, only the first 
slide 😞
It will be greate  if it could create hardlinks for duplicates in other 
subcatologs in "Images". 
Thank You!

Original comment by KnezZ...@gmail.com on 5 Sep 2012 at 1:01

GoogleCodeExporter commented 9 years ago
Found the issues - the duplicate skipping issue was a bit of a dim-witted 
moment - I'd rebuilt the download logic (to resolve an issue on some tumblr 
accounts not always having file extensions..), but forgot to put the existing 
file check back in..

The gif issue is an issue in javax.imageio (which is what I was using to 
determine the file type), by default it only saves the first frame unless you 
do a lot of hacking around, so I've rebuilt it again and ditched the imageio 
logic entirely.

I'm now doing the the file type check by looking at the URLConnection 
getContentType() output - so much simpler!

I'm just messing with a couple more things and I'll attach the source and 
binaries again.

Original comment by s...@stoo.org.uk on 5 Sep 2012 at 9:23

GoogleCodeExporter commented 9 years ago
Here we go...

Duplicate skipping reinstated and Gifs now download properly :)

Original comment by s...@stoo.org.uk on 5 Sep 2012 at 10:38

Attachments:

GoogleCodeExporter commented 9 years ago
Once I've worked out how to use parameters properly in java, I'll add a couple 
of options for overriding the default downloads folder and setting a download 
limit.

Original comment by s...@stoo.org.uk on 5 Sep 2012 at 10:54

GoogleCodeExporter commented 9 years ago
I confirm: animated gifs and avoiding already downloaded files work again ;-D
Thank You!

Original comment by KnezZ...@gmail.com on 6 Sep 2012 at 8:27

GoogleCodeExporter commented 9 years ago
Working good Stoo! Thanks

Original comment by brendon2...@gmail.com on 7 Sep 2012 at 12:01

GoogleCodeExporter commented 9 years ago
[deleted comment]
GoogleCodeExporter commented 9 years ago
works great for me!

I have a request: Could you use a continous numbering for picture sets?

It starts from 1 to 10 so my image viewer sorts them as 1 10 2 3 4 ...

So maybe 0 to 9 (I think tumblr has a 10 picture limit)
or "a" instead of 10
or 01 instead of 1 and so on
would do the trick.

Original comment by me...@derpymail.org on 24 Sep 2012 at 7:31

GoogleCodeExporter commented 9 years ago
hello,
wich version is ready ? .src or . bin
i run all but dont work and i dont understand why?
i have the old version and this run ready.
thanks
Tony

Original comment by antonioc...@gmail.com on 28 Sep 2012 at 6:59

GoogleCodeExporter commented 9 years ago
.bin - you can either directly run the .jar file as is depending on how your OS 
is configured, or running the .bat file if you're on windows, or the .sh shell 
script if you're on linux.

However, there is some bad news - I'm not going to be putting any more updates 
into this version - The reason for this is that tumblr are about to discontinue 
the XML based V1 API that this application uses.

The new V2 API uses an authenticated JSON structure which I'm not completely 
familiar with at the moment, so it would probably be sensible to rewrite the 
application with the new API in mind, especially given all the various issues 
in the code.

For a new tumblr downloader, I'd probably abandon the Java platform in favour 
of .net/mono based one as that's what I'm far more used to coding in.

I'll drop another post in here when I've decided, although given the nature of 
open source, if someone wants to take over and re-tool the existing code, feel 
free to go nuts - it's only what I did anyway :)

Original comment by s...@stoo.org.uk on 23 Oct 2012 at 10:49

GoogleCodeExporter commented 9 years ago
thanks, this software is very util

willi

Original comment by willi.zo...@gmail.com on 24 Dec 2012 at 12:49

GoogleCodeExporter commented 9 years ago
Oh great...
I just hacked my own version together and only now found yours. (and by 
"hacked" I mean, it's really sloppy ;) )
I haven't encountered pics without extension yet, so I haven't implemented that.

It downloads each tumblr-account into its own folder.

If anyone is interested, I'll attach my version, too.

Original comment by M.Le...@gmail.com on 2 Jan 2013 at 11:08

Attachments:

GoogleCodeExporter commented 9 years ago
Program is good. Just not comfortable to download all. For example, if several 
blogs and each in 20,000 images, spent a lot of time to check. You could not 
modify to load the last 50 or 100 and each in its own folder? Thank you!

Original comment by Actionn...@gmail.com on 26 Feb 2013 at 4:28

GoogleCodeExporter commented 9 years ago
[deleted comment]
GoogleCodeExporter commented 9 years ago
Thank you for this.

Original comment by jsiegel...@gmail.com on 10 Jul 2013 at 1:35