AAndyProgram / SCrawler

🏳️‍🌈 Media downloader from any sites, including Twitter, Reddit, Instagram, Threads, Facebook, OnlyFans, YouTube, Pinterest, PornHub, XHamster, XVIDEOS, ThisVid etc.
https://discord.gg/uFNUXvFFmg
GNU General Public License v3.0
1.29k stars 85 forks source link

[BUG] Download Instagram saved posts does not work. #67

Closed Arthurpmrs closed 2 years ago

Arthurpmrs commented 2 years ago

Hello, first I want to thank you for the nice program you developed. I'm trying to download my instagram saved posts, but when I click to start the download it says "Instagram Images: 0; Videos: 0" as shown below:

image

Steps to reproduce the behavior:

  1. In the configuration I added the cookies, copying from Google Chrome.
  2. Added Hash, Hash 2, x-csrftoken, x-ig-app-id, ix-ig-www-claim and my own username (only the username not the URL)
  3. Clicked Ok to save (didn't change anything else).
  4. Clicked the Bookmark icon
  5. Clicked the green button on the window to download instagram saved posts, the message above was showed.

There were no logs in the log window.

Release information (please complete the following information):

About the .NET Framework version: I checked in my Windows/Microsoft.NET folder and the highest version listed is v4.0.30319. However, when I downloaded the .NET runtime v4.6.1 (in this link: https://dotnet.microsoft.com/en-us/download/dotnet-framework/net461) and tried to install it, this message shows:

image

PS: I triple checked all my credentials. I also copied the ffmpeg.exe to the folder. Downloading my own pictures from my profile worked fine.

AAndyProgram commented 2 years ago

Confirmed. I need time to determine what has changed on Instagram.

Arthurpmrs commented 2 years ago

Thanks! Ps: I didn't notice that the text in the second screenshot was in Portuguese. It says "The .NET 4.6.1 or a newer version is already installed in this computer".

AAndyProgram commented 2 years ago

Instagram has made changes again. Good news: I fixed an issue (soon I'll publish a new release (need time for tests)).

Arthurpmrs commented 2 years ago

Thank you very much!

AAndyProgram commented 2 years ago

I need a few days. I started adding missing posts functionality to track and manage posts that weren't downloaded. So when I'm done, I'll post a new release.

AAndyProgram commented 2 years ago

Fixed. Please update to the latest release.

Sorry for taking so long. I started adding another feature that I've wanted to add for a long time and decided to post a new release when I'm done. So, I'm done. Try the new feature - Feed.


If you like SCrawler, please like the program on this site: https://alternativeto.net/software/scrawler/about/.

Arthurpmrs commented 2 years ago

Hello, thank you very much!

Sadly, I could not make it work. I'm probably doing something wrong here. I tried rearranging the hash values, tried re-adding the cookies, tried more than one account. Now the saved dialog box says: "Instagram downloading started" but nothing happens.

AAndyProgram commented 2 years ago

I'm sorry, but I tried right now and the saved photos were downloaded. Have you added your username (Saved posts username) to your Instagram settings? Instagram saved posts require all tokens, cookies, username and Hash2.

AAndyProgram commented 2 years ago

Btw, have you waited enough? Because the text "Instagram downloading started" is displayed when the downloading is just started.

If you have a lot of saved photos, this may take some time.

Arthurpmrs commented 2 years ago

I did wait for some time, but I have a lot of saved posts (possibly more than 10k). I'm gonna try it again tomorrow. Thank you!

Arthurpmrs commented 2 years ago

Hey, I created another account and saved about 50 posts to test it. It works! I'm so sorry for the trouble. The other two accounts that I tested may have more than 10k and 50k posts saved. I was not waiting long enough. Thank you! I'm going to let it download for the whole day tomorrow on my main account.

AAndyProgram commented 2 years ago

I have a lot of saved posts (possibly more than 10k)

WOW!! You'll have to wait for SCrawler to download SO many photos, many, many days!

I'm going to let it download for the whole day tomorrow on my main account.

I think one day is not enough

Look, I'll try to explain. For one request, I receive 50 posts. Unfortunately, I can't get the complete information about the posts with a single request. Complete information means that this site response doesn't provide information about the image gallery (carousel media) of the post. In this case, I can only collect post IDs from those responses. And in the next step, SCrawler will start downloading information about each post. This means that for each post in your array (10k), the site will be asked for information about that post.

You can read about limits on Instagram here.

You can set Post limit timer (Instagram settings) to the lowest value (10000). I have not tested the lowest value and cannot assure you that your account will not be banned. But for some information that I've read, this value (10000) is fine. 60000 is a safe value.

This is a rough estimate of how long parsing will take (for 10k posts): Value = 60000: ((10000-195)60)/60/60/24 ~= 6 days + 19hrs Value = 10000: ((10000-195)10)/60/60/24 ~= 1 day + 3hrs Formula description: ((number of posts - post limit) Post limit timer (in seconds)) / 60 seconds per minute (to get minutes) / 60 minutes per hour (to get hours) / 24 hours a day (to get days)*