BlueBubblesApp / bluebubbles-server

Server for forwarding iMessages to clients within the BlueBubbles App ecosystem
https://bluebubbles.app
Apache License 2.0
554 stars 47 forks source link

Communicate with Private API to access digital touch and handwritten message media #492

Closed carterashwood closed 1 year ago

carterashwood commented 1 year ago

Would it be possible for the server to convert digital touch messages to a normal image format like gif or apng to be viewed on android? I suppose it's just a matter of figuring out how to read it on the server side (it may be an embedded image, but it's probably some custom proprietary thing knowing Apple).

tneotia commented 1 year ago

Its proprietary, and so far we have no idea what format it is in/how to decode it

tneotia commented 1 year ago

this has been figured out with the private api. I'm changing this ticket to focus on the server side communication aspect

tneotia commented 1 year ago

I would recommend creating a new endpoint like /message//digital-touch-attachment and /message//handwritten-attachment, with validation to make sure the provided message is actually a digital touch or handwritten. Then send the event to private API (balloon-bundle-media-path which needs chatGuid and messageGuid), which will return the path of the cached attachment.

zlshames commented 1 year ago

@tneotia what's the format of the transaction response object? or is it just a string to the file path?

zlshames commented 1 year ago

@tneotia also, are the output files GIFs? Or Movs?

tneotia commented 1 year ago

@zlshames yes string to file path, and for digital touch it is mov, for handwritten a png

zlshames commented 1 year ago

Done.