RaghavSood / FBMessageScraper

A python script to download facebook chats
188 stars 42 forks source link

Solution for larger conversations ? #2

Open Pr4w opened 9 years ago

Pr4w commented 9 years ago

Hi !

First of all, thank you for providing this script, this is a very big step forward for what I'm trying to achieve, other solutions haven't quite cut it yet.

Essentially, I have a conversation with a couple of friends, which has somewhere around 310k messages at the moment. We have some really great memories in this conversation and would like to back it all up and possibly print it as a book.

The problem is, and as you have mentioned in the readme, after a while the script seems to stall... Is there any solution to this ? The script has been stalled for a couple of hours now, and relaunching it from that point (after making sure dyn, a, cookie, etc., are all up to date) doesn't seem to make it want to go any further.

image

The script works perfectly on smaller conversations, and I've even written a PHP script to parse the .json into a neat Facebook-looking format, which I'll be posting as soon as I manage to download this conversation fully.

Any ideas on what I could do, or if there is a way this script could be altered for bigger conversations ?

Thanks, Mark

j6k4m8 commented 9 years ago

Facebook is the one that throttles these requests, so I doubt there's a clever way of fixing this problem locally.

However, I've had luck running long threads overnight; maybe that's worth a shot before we start approaching the codebase?

Pr4w commented 9 years ago

Hi,

Yeah I've let it run overnight once before, I'll give it another go tonight and see how it goes, but it feels like it's pretty much jammed around the same message count (around 80k) unfortunately..

ShaneOH commented 9 years ago

Pr4w,

Any headway on this?

Pr4w commented 9 years ago

@ShaneOH Nope, still unable to download a large conversation

Vuneu commented 8 years ago

@Pr4w Hey! Today I tried downloading the messages from one of my conversations, and the script has gone as far as 914k messages, maybe you should give it a try again?