search

peerdavid / remapy

An open source explorer for your remarkable tablet to show, upload or delete files via the remarkable cloud.
Apache License 2.0
174 stars 19 forks source link

Remapy has stopped synchronizing with remarkable cloud #47

Open James-G-McDonald opened 3 years ago

James-G-McDonald commented 3 years ago

Hi. I really love this project and use it all the time.

About a week ago, remapy has stopped syncing with my remarkable cloud account. It seems to log in and says that is is syncing all documents, but does not update any local files.

What's even weirder, if I click "ReSync", it re-downloads all the documents, but does not get any new updates or recently added files that are in my cloud account.

I tried reconnecting both remapy and my remarkable with my cloud account, just to be sure they are connected to the same account, but it didn't help.

Is this a common issue? Thanks a lot! I love the project.

peerdavid commented 3 years ago

There was a bug with the url recently and sync still works for me -can you please try to rename the .remapy folder in your home directory and setup everything else? Also I wonder if you start remapy in the console do you get some error messages?

Best, David

James-G-McDonald commented 3 years ago

Thanks for the swift reply. I appreciate it.

I completely deleted remapy as well as my .remapy folder. After re-installing and reconnecting with my remarkable account, it still syncs with my files from about 2 weeks ago. It's very strange.

Running from the terminal gives me no error meesages.

I installed the official remarkable app on my phone and it is syncing correctly with changes I make on my remarkable tablet. It's very strange that remapy seems to be seeing the state of files from 2 weeks ago (including files that I deleted from my remarkable), even after completely re-installing.

I would love to be able to keep using remapy. I really appreciate any ideas you have.

Thanks.

larskotthoff commented 3 years ago

I have the same problem. I can also upload new files through remapy that will show up and survive a resync, but never make it to the tablet.

peerdavid commented 3 years ago

I think those are two different problems right? @James-G-McDonald You can not see updates and @larskotthoff you can not upload files right?

I just tested both things and the really bad thing is that I can not reproduce your problem - is there something that changed recently?

Thanks a lot, David

philippstehr commented 3 years ago

I'm having the exact same problem. No matter what I do, the remapy client always syncs back to a state from last week, even after having deleted all remapy folders and reinstalled.

If I try to upload a file, as @larskotthoff has described, the file shows up in the client and remains there after re-starting the program. However, it never makes it to the tablet.

peerdavid commented 3 years ago

Thanks a lot - it seems that this is a more general issue as exactly the same problem also exist for rmapi: https://github.com/juruen/rmapi/issues/187

Cheers, David

peerdavid commented 3 years ago

May I ask if you use the release branch or the reMarkable software beta branch?

philippstehr commented 3 years ago

That is somewhat assuring! I am on the regular software release schedule I guess, never changed anything about this. The tablet says it is running 2.8.0.98

flomlo commented 3 years ago

That is the same version as I, but I tells me that I am on the beta branch.

I'll investigate further (from the rmapi side), but not before the weekend.

James-G-McDonald commented 3 years ago

I noticed in the discussion over at rmapi that someone with this issue recently did a factory reset. I also did a factory reset around the time the problem started. I wonder if that is related.

philippstehr commented 3 years ago

I have never done a factory reset.

flomlo commented 3 years ago

I've not (yet), as well. But I can remember uploading a slightly corrupt .pdf, afterwards it stopped working.

larskotthoff commented 3 years ago

I have both problems and also never performed a factory reset. I'm on the normal release schedule.

ddvk commented 3 years ago

can you ping/traceroute: document-storage-production-dot-remarkable-production.appspot.com

and the result of: curl "https://service-manager-production-dot-remarkable-production.appspot.com:443/service/json/1/webapp?environment=production&group=&apiVer=3"

and

curl "https://service-manager-production-dot-remarkable-production.appspot.com:443/service/json/1/document-storage?environment=production&apiVer=2"

larskotthoff commented 3 years ago

I can ping the address. First curl:

{"Status":"OK","Host":"webapp-production-dot-remarkable-production.appspot.com"}

Second curl:

{"Status":"OK","Host":"document-storage-production-dot-remarkable-production.appspot.com"}
philippstehr commented 3 years ago

Can also ping the address.

Output for the curls:

{"Status":"OK","Host":"webapp-production-dot-remarkable-production.appspot.com"}

{"Status":"OK","Host":"document-storage-production-dot-remarkable-production.appspot.com"}

peerdavid commented 3 years ago

@larskotthoff @phiste What I wonder the current page is shown in RemaPy - is this updated correctly? Also if you change something on the device and you click the sync button in RemaPy is the file downloaded again or nothing happens after you click this button?

Also, it would be interesting how the official client e.g. lists files (/document-storage/json/2/docs request) --> is it possible for you to use a packet sniffer to trace this and share it with me? That would be really cool an help me a lot :)

Thank you, David

larskotthoff commented 3 years ago

It's like RemaPy is syncing with a different set of files -- they are redownloaded on resync, but no changes made on the tablet are propagated. I've tried sniffing the traffic from the android app, but it's all https.

flomlo commented 3 years ago

Thats the traceroute:

traceroute to document-storage-production-dot-remarkable-production.appspot.com (142.251.36.180), 30 hops max, 60 byte packets
 1  _gateway (192.168.0.1)  1.648 ms  2.635 ms  3.604 ms
 2  217-25-120-4.static.upcbusiness.at (217.25.120.4)  35.756 ms  36.421 ms  36.113 ms
 3  217-25-122-252.static.upcbusiness.at (217.25.122.252)  37.409 ms  36.803 ms  37.087 ms
 4  217-25-123-7.static.upcbusiness.at (217.25.123.7)  37.654 ms  37.949 ms  38.219 ms
 5  * * *
 6  * * *
 7  muc12s11-in-f20.1e100.net (142.251.36.180)  47.168 ms 209.85.252.208 (209.85.252.208)  19.953 ms 142.251.68.120 (142.251.68.120)  19.444 ms

Note that it changes a lot, occasionally 10 hops, sometimes 6.

furthermore, curl results in: {"Status":"OK","Host":"webapp-production-dot-remarkable-production.appspot.com"} for the first (apiVer3=3) and {"Status":"OK","Host":"document-storage-production-dot-remarkable-production.appspot.com"} for the second.

peerdavid commented 3 years ago

Some are working on the new API (https://github.com/subutux/rmapy/pull/26). Whenever my own account is updated I will test thisapproach and update RemaPy accordingly.

peerdavid commented 3 years ago

There is now a relly cool document (https://docs.google.com/document/d/1peZh79C2BThlp2AC3sITzinAQKJccQ1gn9ppdCIWLl8/edit) that describes the new reMarkable cloud API version - I'm currently really busy so any help is welcome.