search

agermanidis / SnapchatBot

[deprecated] Python library for building bots that live on Snapchat
MIT License
517 stars 105 forks source link

Error when getting a video from a friend. #18

Closed N07070 closed 5 years ago

N07070 commented 9 years ago 
Traceback (most recent call last):
  File "storyfbbot-dev.py", line 40, in <module>
    bot.listen()
  File "/home/n07070/Code/SnapchatBot/snapchat_bots/bot.py", line 54, in listen
    self.on_snap(snap.sender, snap)
  File "storyfbbot-dev.py", line 26, in on_snap
    self.post_story(snap)
  File "/home/n07070/Code/SnapchatBot/snapchat_bots/bot.py", line 101, in post_story
    snap.upload(self)
  File "/home/n07070/Code/SnapchatBot/snapchat_bots/snap.py", line 40, in upload
    self.media_id = bot.client.upload(self.file.name)
  File "build/bdist.linux-i686/egg/pysnap/__init__.py", line 353, in upload
ValueError: Could not determine media type for given data

I'm trying to fix it. Could use a little help :wink: Edit: Works with the iPhone 6, but not with Android Phones ( OnePlus One )

Traceback (most recent call last): File "./storyfbbot-dev.py", line 40, in <module> bot.listen() File "/home/n07070/Code/SnapchatBot/snapchat_bots/bot.py", line 54, in listen self.on_snap(snap.sender, snap) File "./storyfbbot-dev.py", line 26, in on_snap self.post_story(snap) File "/home/n07070/Code/SnapchatBot/snapchat_bots/bot.py", line 101, in post_story snap.upload(self) File "/home/n07070/Code/SnapchatBot/snapchat_bots/snap.py", line 40, in upload self.media_id = bot.client.upload(self.file.name) File "build/bdist.linux-i686/egg/pysnap/__init__.py", line 353, in upload ValueError: Could not determine media type for given data

jackbillstrom commented 9 years ago

I actually got a video from a friend, but I couldn't open it. Seems like it's broken.

Mac OS X 10.10.2

N07070 commented 9 years ago

You sent a video from a Mac with snapchat ? Did you receive it ? I will try to send a few test videos to the bot, then post results.

jackbillstrom commented 9 years ago

@N07070 No, sorry I meant that I'm running on a Mac

N07070 commented 9 years ago

Could you try to run it on another system ( windows,linux,bsd ? )

jackbillstrom commented 9 years ago

@N07070 I recieved it, and saved it. I could try running it on linux within the next hour I believe.

N07070 commented 9 years ago

Could not reproduce with my OnePlus. Assuming it's fixed ? I will try with another phone. @jackbillstrom , it could be cool. Also, can you send snaps to the bot, that will then repost it or send it to another friend ? ( Like with the reflector or stroryfier bot ? )

jackbillstrom commented 9 years ago

@N07070 Haven't tried those yet, just modified the autowelcomebot.pywith my needs. I'll try and report.

Rob-- commented 9 years ago

@N07070 - yes, of course, why wouldn't you be able to? You could also pick a random person from your friends list to send it to.

N07070 commented 9 years ago

I was actually more geunily curious, but it is true that a random snap service would be pretty neat. A thing a bit like Fling. @jackbillstrom is your issue fixed ?

ShaneIsrael commented 9 years ago

My bot will crash with the exact error same error if either myself (Nexus 4) or two of my friends (iPhone 5) send it any form of video. However, other people (I don't know the device or snapchat version) have successfully sent it a video.

N07070 commented 9 years ago

Seems to be an error with the determination of media type ( which is strange, cause it's supposed to be all .mp4 )

N07070 commented 9 years ago

Up, I'm still getting the error. It seems to come from pysnap, so I would like to update pysnap to do that. Is it possible ? Could we update to using the last version of pysnap ?

The snap sent is a video.

[2015-03-03 00:41:41,167] [FbStoryBot-62b3] Recived a snap from xxxx
[2015-03-03 00:41:41,167] [FbStoryBot-62b3] Uploading snap
Traceback (most recent call last):
  File "dev.py", line 40, in <module>
    bot.listen()
  File "/snapchat_bots/bot.py", line 58, in listen
    self.on_snap(snap.sender, snap)
  File "dev.py", line 26, in on_snap
    self.post_story(snap)
  File "/snapchat_bots/bot.py", line 105, in post_story
    snap.upload(self)
  File "/snapchat_bots/snap.py", line 40, in upload
    self.media_id = bot.client.upload(self.file.name)
  File "build/bdist.linux-i686/egg/pysnap/__init__.py", line 353, in upload
ValueError: Could not determine media type for given data
Rob-- commented 9 years ago

I can't look into this now, but it might be worth cloning the library, edit some code involved with retrieving the file type and then installing that library.

Sh1eld commented 9 years ago

PIL and ImageMagick installed? Only thing I can think of because I am not having this issue and I have both of these installed.

ShaneIsrael commented 9 years ago

I have both of those installed and still get the issue.

agermanidis commented 9 years ago

Works with the iPhone 6, but not with Android Phones

I think that might be key. Snapchat for Android might be sending the data of the snap gzipped, unlike the iOS version which sends raw data. SnapchatBot is not handling the gzipped case right now, as I only had an iPhone, so I never encountered that case while testing it. I'll add code to unzip the data and then process it.

agermanidis commented 9 years ago

To the others who are encountering this issue: what phone are the snaps you're trying to process being sent from?

@jackbillstrom @ShaneIsrael

N07070 commented 9 years ago

@agermanidis do you think you could get an android phone for a few days to test ? I could provide a small, old, galaxy Y phone.

ShaneIsrael commented 9 years ago

I have an android phone and I could test, however for some reason I am getting a 400 Client Error: Bad Request when trying to run my bot from my computer. However, I can log into it connected to my wifi from my phone so I'm not sure what the problem is there. Wasn't an issue yesterday or previous days.

On Tue, Mar 3, 2015 at 2:26 PM, N07070 notifications@github.com wrote:

@agermanidis https://github.com/agermanidis do you think you could get an android phone for a few days to test ? I could provide a small, old, galaxy Y phone.

— Reply to this email directly or view it on GitHub https://github.com/agermanidis/SnapchatBot/issues/18#issuecomment-77038106 .

N07070 commented 9 years ago

It seems that it's an error with our IPs being banned.

ShaneIsrael commented 9 years ago

That doesn't make sense though. I have the exact same IP address on my phone and can log into it on my phone just fine.

I looked up 400 Client Error and it has something to do with sending the log in info in an unrecognized format. I wonder if Snapchat made a change on their end.

On Tue, Mar 3, 2015 at 2:29 PM, N07070 notifications@github.com wrote:

It seems that it's an error with our IPs being banned.

— Reply to this email directly or view it on GitHub https://github.com/agermanidis/SnapchatBot/issues/18#issuecomment-77039142 .

N07070 commented 9 years ago

Fixed. Okay, but the issue is still not fixed with videos :smile:

Rob-- commented 9 years ago

If you have a look at the open issue about a 400 Bad Request error you can follow the updates on the situation, basically Snapchat have most likely tried pushing users to loq (as logging in with this part of the API requires more tokens and is somewhat securer). I'm currently recreating this library to work with all of the latest API's endpoints.

ShaneIsrael commented 9 years ago

Awesome thank you! Can't wait until the videos are working. Thanks for the quick response! :)

On Wed, Mar 4, 2015 at 4:36 PM, N07070 notifications@github.com wrote:

Fixed. Okay, but the issue is still not fixed with videos [image: :smile:]

— Reply to this email directly or view it on GitHub https://github.com/agermanidis/SnapchatBot/issues/18#issuecomment-77274885 .

Rob-- commented 9 years ago

The videos should be working - right now I've got a bot running on a server that can handle videos. If you provide me with more information, I can try and solve the issue if I have time tomorrow.

ShaneIsrael commented 9 years ago

All I know is that when I (Android (lollipop) nexus 4) or my friends on iPhone 5's and 5s's send videos to the bot, it crashes with the error being unable to identify media type. (I have imageshack and ffmpeg installed). However, some people (don't know who they are) are able to get videos through occasionally without crashing the bot. No idea what phones they have.

On Wed, Mar 4, 2015 at 4:52 PM, Robert notifications@github.com wrote:

The videos should be working - right now I've got I've got a bot running on a server that can handle videos. If you provide me with more information, I can try and solve the issue if I have time tomorrow.

— Reply to this email directly or view it on GitHub https://github.com/agermanidis/SnapchatBot/issues/18#issuecomment-77277098 .

N07070 commented 9 years ago

It seems to be very random, sometimes it's okay, sometimes no...

Traceback (most recent call last):
  File "./storyfbbot-dev.py", line 40, in <module>
    bot.listen()
  File "SnapchatBot/snapchat_bots/bot.py", line 66, in listen
    self.on_snap(snap.sender, snap)
  File "./storyfbbot-dev.py", line 26, in on_snap
    self.post_story(snap)
  File "/SnapchatBot/snapchat_bots/bot.py", line 113, in post_story
    snap.upload(self)
  File "SnapchatBot/snapchat_bots/snap.py", line 40, in upload
    self.media_id = bot.client.upload(self.file.name)
  File "build/bdist.linux-i686/egg/pysnap/__init__.py", line 353, in upload
ValueError: Could not determine media type for given data
feedthedogs commented 9 years ago

I am getting the same issue, I tried saving the file and the images work but the videos come out as 0 bytes, it could be the zip issue, but it looks like pysnap takes care of that?

PhlexPlexico commented 9 years ago

I have the same issue happening with me. I'm able to send videos without text on the screen. However, if there is no text it sends just fine. Using SnapPrefs on android, I do believe the video and text are saved as separate files. I.e. the videos are saved as MP4s, and the text is saved as a jpg. Could this perchance be the problem?

Rob-- commented 9 years ago

@feedthedogs I had the same issue with saving files, I found another simpler solution (only three lines).

Python has a handy library called pdb. You can import it and call pdb.set_trace(). This will allow you step through your code and debug it line by line (after set_trace() is called, type n and press enter in the console to step over the code). I suggest downloading this library, setting a few traces around functions where you think the error could be caused and then installing your now customised library. This will allow you to identify exactly where the error is occurring. You can also call variables to print them out (just type the variable name and press enter).

N07070 commented 9 years ago

E: I think the problem comes from snaps with text that are both jpg and mp4.

PhlexPlexico commented 9 years ago

@N07070 that being said with the snaps being sent as both jpeg and mp4, any ideas how these are sent over Snapchat? As previously commented, are they gzipped then sent to be extracted on the client end? Would it be possible to redirect the entire snap somehow without the api touching it and separating the text jpg and the mp4? I haven't poked around much in the library, and plan to look more in the coming weeks as this is a very interesting library to work with.

N07070 commented 9 years ago

I really don't have the competence to help out with this, sorry man...

ishaantaylor commented 9 years ago

I'm also having an issue saving any videos at all (they come up as 0 bytes). These have been sent from a variety of phones. Generally, I can manipulate the snaps even if they are videos. However, there was one error with a Galaxy S3 that the bot was crashing when it tried to send it a video. (This doesn't happen any more.)

Additionally, how would you suggest updating the library so it is up to date with the master branch here? Would a git pull then python setup.py install work? Or should I uninstall it first?

N07070 commented 9 years ago

So, for me, it's just when there is texte added. To update, I just do a git pull.

Le 10 mars 2015 12:11:10 GMT+01:00, Ishaan Taylor notifications@github.com a écrit :

I'm also having an issue saving any videos at all (they come up as 0 bytes). These have been sent from a variety of phones. Generally, I can manipulate the snaps even if they are videos. However, there was one error with a Galaxy S3 that the bot was crashing when it tried to send it a video. (This doesn't happen any more.)

Additionally, how would you suggest updating the library so it is up to date with the master branch here? Would a git pull then python setup.py install work? Or should I uninstall it first?

Reply to this email directly or view it on GitHub: https://github.com/agermanidis/SnapchatBot/issues/18#issuecomment-78034197

Envoyé de mon appareil Android avec K-9 Mail. Veuillez excuser ma brièveté.

PhlexPlexico commented 9 years ago

@agermanidis has there been any progress to this? Any idea if another pysnap library has figured out this issue? I'm still getting it on my end.

Rob-- commented 9 years ago

@PhlexPlexico, my library can 'save' snaps. When downloading a snap a temporary file is made, my save_snap method just copies this file to a given directory. Check out my library for the method.

N07070 commented 9 years ago

If you save snaps, you juste repost it using the Snap.from_file() method ?

Rob-- commented 9 years ago

What do you mean?

krissrex commented 9 years ago

I think he means:

If you save a snap, do you just repost it by using the method Snap.from_file(saved_snap)

N07070 commented 9 years ago

Yes, indeed.

krissrex commented 9 years ago

I believe the error exists in pysnap, and not in SnapchatBot. To be exact, it is this function in init.py

def is_video(data):
    return len(data) > 1 and data[0:2] == b'\x00\x00'

My guess is that the byte matching fails. When I print the bytes of two random video tempfiles, they start like this: 504b030414 504b030414 Which obviously fails the check, as the 2 first bytes are not 0x00 0x00, but rather 0x50 0x4B.

Wikipedia says the signature 50 4B 03 04 is used by zip, jar, odt, ods, odp, docx, xlsx, pptx, apk source. The actual tempfile has extension .mp4.

Renaming the mp4 tempfile to a zip works, and I can open it and view the contents, like the text overlay.

agermanidis commented 9 years ago

Can you send me the file (see email in profile) so I can test some code against it? Phone is having camera issues so I can't generate a test video snap with a caption right now.

krissrex commented 9 years ago

I will do that. Pysnap needs to be changed several places; first it needs to detect zip as video, then it needs to set the zipped-value to 1 in the json-request when the file is a zip.

Detecting it as a video is trivial:

def is_video(data):
    signature = data[0:2]
    return len(data) > 1 and (signature == b'\x00\x00' or signature == b'\x50\x4B')

This is under the assumption that the zip will never be an image. (The signature b'\x50\x4B' can optionally be replaced with b'PK' as they are equivalent.)

N07070 commented 9 years ago

Will it be updated soon ? How could I help you ?

krissrex commented 9 years ago

The file uploaded from android is indeed a .zip. Also, it has type 2 when the video is muted, and type 1 when it is normal. So a videosnap with text is a zip with a type that matches its video. In the POST to /loq/send, it has the field "zipped" set to 1.

agermanidis commented 9 years ago

I'm working on supporting captions generally, both in incoming snaps (with the text being OCR'ed and available to the user), and in creating new snaps to send. Will release soon.

The "zipped" field doesn't really matter, it's easy to detect whether data is zipped or not (from the first bytes). The zip file just contains the video and a jpg text overlay.

On Sun, Mar 15, 2015 at 8:52 PM, Kristian Rekstad notifications@github.com wrote:

The file uploaded from android is indeed a .zip. Also, it has type 2 when the video is muted, and type 1 when it is normal. So a videosnap with text is a zip with a type that matches its video. In the POST to /loq/send, it has the field "zipped" set to 1.

— Reply to this email directly or view it on GitHub https://github.com/agermanidis/SnapchatBot/issues/18#issuecomment-81315456 .

Anastasis Germanidis (860) 807-5860

ShaneIsrael commented 9 years ago

I have a bot that I have been coding on for a while to do a bunch of different things. I can sent it commands via the text on the image and it will do stuff based on the commands received. I'm using the tesseract OCR library to parse the text.

bl3ndom commented 9 years ago

I think that this crash got something to do with this. [2015-03-17 03:39:23,004] "POST /bq/blob HTTP/1.1" 200 1078048 Traceback (most recent call last): File "storifierbot.py", line 17, in bot.listen() File "build/bdist.linux-x86_64/egg/snapchat_bots/bot.py", line 62, in listen File "build/bdist.linux-x86_64/egg/snapchat_bots/bot.py", line 172, in get_snaps File "build/bdist.linux-x86_64/egg/snapchat_bots/bot.py", line 146, in process_snaps File "build/bdist.linux-x86_64/egg/snapchat_bots/bot.py", line 53, in process_snap File "build/bdist.linux-x86_64/egg/snapchat_bots/snap.py", line 93, in init IOError: File not open for writing

After logging in from phone and watching video-snap, everything works.

Im using CentOS 7, installed today.

krissrex commented 9 years ago

@bl3ndom This is a different issue. Try running it with sudo.