ddvk / rmfakecloud

host your own cloud for the remarkable
GNU Affero General Public License v3.0
705 stars 57 forks source link

reMarkable tablet sync breaks on 3.2.2.1581 #220

Closed zcy85611 closed 1 year ago

zcy85611 commented 1 year ago

I just updated to 3.2.2.1581, with everything unchanged, the sync on remarkable breaks

it can be paired and when paired, it will sync once, but after the sync, it keeps telling the sync is breaking

when I downgrade to 3.0.4.1305, everything works fine

and the script "grep sync ~/.local/share/remarkable/xochitl/*.metadata -l | xargs sed -i 's/synced\": true/synced\": false/'" also breaks on 3.2.2, but works fine on 3.0.4

I assume there is something changed on 3.2.2 to break the sync, would you please help look into it please? thanks

Eeems commented 1 year ago

Are you using the latest sync mechanism?

https://github.com/ddvk/rmfakecloud/blob/master/docs/usage/diff-sync.md

nemunaire commented 1 year ago

It works fine for me on 3.2.2.1581, with sync 1.5.

However I noticed the cloud icon in the status bar seems to persist in offline state (but the sync is effective anyway and all features works correctly).

daniel-naegele commented 1 year ago

Hi, I have the same issue. I am using sync 1.5, and had no issues before upgrading. Almost all of them have "synced": false, in it. Interestingly, Sending Mails, Converting Handwritten Notes, Integrations, such as my own Nextcloud work without issues. Also, there are no API calls coming from the tablet regarding sync, but for example from integrations.

zcy85611 commented 1 year ago

Are you using the latest sync mechanism?

https://github.com/ddvk/rmfakecloud/blob/master/docs/usage/diff-sync.md

yes,I am, sync 1.5

Eeems commented 1 year ago

Have you checked the logs for the sync service to see if it is raising any errors? journacltl -aeu sync

zcy85611 commented 1 year ago

I go to the [storage] -> [check sync], it gives "there are some issues with the cloud connection, please try again later"

I also upload a book on windows desktop app ver. 3.1.0.712, it sync with no problem with the server, but no response on remarkable tablet

here is the log

"[[0;1;39m-- Reboot --[[0m Mar 03 01:00:42 reMarkable systemd[1]: Started reMarkable Document Sync. Mar 03 01:00:43 reMarkable sync[245]: Lock in temp location Mar 03 01:00:43 reMarkable sync[245]: Installing crash handler Mar 03 01:00:43 reMarkable sync[245]: installed crash handler Mar 03 01:00:43 reMarkable sync[245]: Running service... Mar 03 01:01:32 reMarkable systemd[1]: Stopping reMarkable Document Sync... Mar 03 01:01:32 reMarkable systemd[1]: sync.service: Succeeded. Mar 03 01:01:32 reMarkable systemd[1]: Stopped reMarkable Document Sync. [[0;1;39m-- Reboot --[[0m Mar 03 01:01:53 reMarkable systemd[1]: Started reMarkable Document Sync. Mar 03 01:01:53 reMarkable sync[239]: Lock in temp location Mar 03 01:01:54 reMarkable sync[239]: Installing crash handler Mar 03 01:01:54 reMarkable sync[239]: installed crash handler Mar 03 01:01:54 reMarkable sync[239]: Running service... "

Eeems commented 1 year ago

Alright, so there don't seem to be errors there. How about the xochitl log? Especially just after checking sync. journalctl -aeu xochitl

zcy85611 commented 1 year ago

journalctl -aeu xochitl

no log, "No journal files were found"

Eeems commented 1 year ago

Are you sure you spelled it correctly?

zcy85611 commented 1 year ago

Are you sure you spelled it correctly?

sorry, use the command on my laptop not remarkable, here is the log

Mar 02 14:20:43 reMarkable xochitl[222]: Unable to load waveform from file: /usr/share/remarkable/speedy-gonzales.csv Mar 02 14:20:43 reMarkable xochitl[222]: 14:20:43.121 [[01;33mdefault Unable to export waveform table.[[0m Mar 02 14:20:43 reMarkable xochitl[222]: 14:20:43.149 [[01;33mdefault QStandardPaths: XDG_RUNTIME_DIR not set, defaulting to '/tmp/runtime-root'[[0m Mar 02 14:20:43 reMarkable xochitl[222]: 14:20:43.158 [[02;32mrm.epaperkeyboardhandler Try to create keyboard handler for "/dev/input/event0" ""[[0m Mar 02 14:20:43 reMarkable xochitl[222]: 14:20:43.158 [[02;32mrm.epaperkeyboardhandler Opening keyboard at /dev/input/event0[[0m Mar 02 14:20:43 reMarkable xochitl[222]: 14:20:43.158 [[02;32mrm.epaperkeyboardhandler Create keyboard handler with for device "/dev/input/ev ent0"[[0m Mar 02 14:20:43 reMarkable xochitl[222]: 14:20:43.159 [[02;32mrm.epaperkeyboardhandler Input locale setting has changed, updating the key map .[[0m Mar 02 14:20:43 reMarkable xochitl[222]: 14:20:43.160 [[02;32mrm.epaperkeyboardhandler Read a langCode of ""[[0m Mar 02 14:20:43 reMarkable xochitl[222]: 14:20:43.160 [[01;33mrm.epaperkeyboardhandler No keymap set by QT settings or firmware, defaulting t o US.[[0m Mar 02 14:20:43 reMarkable xochitl[222]: 14:20:43.161 [[02;32mrm.epaperkeyboardhandler setting US keymap 293 147[[0m Mar 02 14:20:43 reMarkable xochitl[222]: 14:20:43.161 [[02;32mrm.epaperkeyboardhandler numlock=0 , capslock=0, scrolllock=0[[0m Mar 02 14:20:43 reMarkable xochitl[222]: 14:20:43.161 [[02;32mrm.epaperkeyboardhandler Read a langCode of ""[[0m Mar 02 14:20:43 reMarkable xochitl[222]: 14:20:43.162 [[01;33mrm.epaperkeyboardhandler No keymap set by QT settings or firmware, defaulting t o US.[[0m Mar 02 14:20:43 reMarkable xochitl[222]: 14:20:43.162 [[02;32mrm.epaperkeyboardhandler setting US keymap 293 147[[0m Mar 02 14:20:43 reMarkable xochitl[222]: 14:20:43.162 [[02;32mrm.epaperkeyboardhandler numlock=0 , capslock=0, scrolllock=0[[0m Mar 02 14:20:43 reMarkable xochitl[222]: 14:20:43.162 [[02;32mrm.epaperkeyboardhandler Try to create keyboard handler for "/dev/input/event2" ""[[0m Mar 02 14:20:43 reMarkable xochitl[222]: 14:20:43.162 [[02;32mrm.epaperkeyboardhandler Opening keyboard at /dev/input/event2[[0m Mar 02 14:20:43 reMarkable xochitl[222]: 14:20:43.170 [[02;32mrm.epaperkeyboardhandler Create keyboard handler with for device "/dev/input/ev ent2"[[0m Mar 02 14:20:43 reMarkable xochitl[222]: 14:20:43.170 [[02;32mrm.epaperkeyboardhandler Input locale setting has changed, updating the key map .[[0m Mar 02 14:20:43 reMarkable xochitl[222]: 14:20:43.171 [[02;32mrm.epaperkeyboardhandler Read a langCode of ""[[0m

Eeems commented 1 year ago

And this coveres when you pressed the check sync button? I don't see anything related in the log.

zcy85611 commented 1 year ago

And this coveres when you pressed the check sync button? I don't see anything related in the log.

yes, it covers, it seems to be the log I updated the system yesterday, no new log today when I click [check sync], but "journalctl -aeu sync" has new log today

Eeems commented 1 year ago

You can watch the output of the log live with the following command journalctl -fau xochitl. With this you can watch what it does when you press the button. The command you have previously would not update live, and would just give you the end of the log at the time you ran it.

zcy85611 commented 1 year ago

I click [check sync] and opend a book and turned several pages and close it. after I close the book, it starts to sync, but still the sync icon tells no sync and [check sync] tells "there are some issues with the cloud connection, please try again later"

xhochitl log

Mar 03 01:09:52 reMarkable xochitl[240]: 01:09:52.766 rm.telemetry
Mar 03 01:09:52 reMarkable xochitl[240]: 01:09:52.992 rm.wifi                  wlan0: Address added: xxxxxxx
Mar 03 01:09:52 reMarkable xochitl[240]: 01:09:52.995 rm.wifi                  wlan0: Address added: xxxxxx
Mar 03 01:09:54 reMarkable xochitl[240]: 01:09:54.862 rm.wifi                  wlan0: Address added: xxxxx
Mar 03 01:09:54 reMarkable xochitl[240]: 01:09:54.870 rm.wifi                  Got gateway: xxxxxx
Mar 03 01:09:54 reMarkable xochitl[240]: 01:09:54.873 rm.wifi                  We probably have Internet
Mar 03 01:09:54 reMarkable xochitl[240]: 01:09:54.873 rm.network.notifications Notifications socket is not OK: UnconnectedState (checkIfShouldConnect /usr/src/debug/xochitl/override+gitAUTOINC+bfef6a8c35-r0/git/src/notifications/src/notifications.cpp:187)
Mar 03 01:09:55 reMarkable xochitl[240]: 01:09:55.550 rm.network.hostnames     Could not find hostname for service "notifications" (parseNetworkReply /usr/src/debug/xochitl/override+gitAUTOINC+bfef6a8c35-r0/git/src/network/src/servicehostname.cpp:44)
Mar 03 01:20:38 reMarkable xochitl[240]: 01:20:38.658 rm.documentlockmanager   Opening document in locked mode: "1146363d-d2b1-4aa7-acc3-a808c99ebbbe"  (setDocument /usr/src/debug/xochitl/override+gitAUTOINC+bfef6a8c35-r0/git/src/entry/src/documentlockmanager.cpp:46)
Mar 03 01:20:38 reMarkable xochitl[240]: 01:20:38.667 rm.docworker              -> worker on 1146363d-d2b1-4aa7-acc3-a808c99ebbbe now running
Mar 03 01:20:38 reMarkable xochitl[240]: 01:20:38.797 rm.epaperkeyboardhandler Input locale setting has changed, updating the key map.
Mar 03 01:20:38 reMarkable xochitl[240]: 01:20:38.799 rm.epaperkeyboardhandler Read a langCode of  ""
Mar 03 01:20:38 reMarkable xochitl[240]: 01:20:38.800 rm.epaperkeyboardhandler No keymap set by QT settings or firmware, defaulting to US.
Mar 03 01:20:38 reMarkable xochitl[240]: 01:20:38.800 rm.epaperkeyboardhandler setting US keymap 293 147
Mar 03 01:20:38 reMarkable xochitl[240]: 01:20:38.800 rm.epaperkeyboardhandler numlock=0 , capslock=0, scrolllock=0
Mar 03 01:20:38 reMarkable xochitl[240]: 01:20:38.801 rm.epaperkeyboardhandler Input locale setting has changed, updating the key map.
Mar 03 01:20:38 reMarkable xochitl[240]: 01:20:38.802 rm.epaperkeyboardhandler Read a langCode of  ""
Mar 03 01:20:38 reMarkable xochitl[240]: 01:20:38.802 rm.epaperkeyboardhandler No keymap set by QT settings or firmware, defaulting to US.
Mar 03 01:20:38 reMarkable xochitl[240]: 01:20:38.802 rm.epaperkeyboardhandler setting US keymap 293 147
Mar 03 01:20:38 reMarkable xochitl[240]: 01:20:38.802 rm.epaperkeyboardhandler numlock=0 , capslock=0, scrolllock=0
Mar 03 01:20:38 reMarkable xochitl[240]: 01:20:38.808 rm.document.epub         Invalid guide item "text/part0069.html" "" "cover"
Mar 03 01:20:38 reMarkable xochitl[240]: 01:20:38.815 rm.docworker                 loaded pageId="f0a6e4fc-3e5e-4edd-9a21-d65568f9f75e" - no file found (loadLinesForPageUnprotected /usr/src/debug/xochitl/override+gitAUTOINC+bfef6a8c35-r0/git/src/worker/src/documentworker.cpp:1917)
Mar 03 01:20:38 reMarkable xochitl[240]: 01:20:38.831 rm.docworker                 loaded pageId="d001fe09-05f4-41c8-b050-9ec61d6b4e9d" - no file found (loadLinesForPageUnprotected /usr/src/debug/xochitl/override+gitAUTOINC+bfef6a8c35-r0/git/src/worker/src/documentworker.cpp:1917)
Mar 03 01:20:42 reMarkable xochitl[240]: 01:20:42.722 rm.docworker                 loaded pageId="ce1026cd-21ab-4360-b18f-11ecf32a4fe1" - no file found (loadLinesForPageUnprotected /usr/src/debug/xochitl/override+gitAUTOINC+bfef6a8c35-r0/git/src/worker/src/documentworker.cpp:1917)
Mar 03 01:20:45 reMarkable xochitl[240]: 01:20:45.394 rm.docworker                 loaded pageId="2d861752-8a82-414c-8248-a2b90d5f3526" - no file found (loadLinesForPageUnprotected /usr/src/debug/xochitl/override+gitAUTOINC+bfef6a8c35-r0/git/src/worker/src/documentworker.cpp:1917)
Mar 03 01:20:47 reMarkable xochitl[240]: 01:20:47.741 rm.documentlockmanager   complete and save changes for document "1146363d-d2b1-4aa7-acc3-a808c99ebbbe"  (setDocument /usr/src/debug/xochitl/override+gitAUTOINC+bfef6a8c35-r0/git/src/entry/src/documentlockmanager.cpp:33)
Mar 03 01:20:48 reMarkable xochitl[240]: 01:20:48.895 rm.docworker              -> worker on 1146363d-d2b1-4aa7-acc3-a808c99ebbbe now exiting (run /usr/src/debug/xochitl/override+gitAUTOINC+bfef6a8c35-r0/git/src/worker/src/documentworker.cpp:1136)
Mar 03 01:20:48 reMarkable xochitl[240]: 01:20:48.913 rm.epaperkeyboardhandler Input locale setting has changed, updating the key map.
Mar 03 01:20:48 reMarkable xochitl[240]: 01:20:48.914 rm.epaperkeyboardhandler Read a langCode of  ""
Mar 03 01:20:48 reMarkable xochitl[240]: 01:20:48.914 rm.epaperkeyboardhandler No keymap set by QT settings or firmware, defaulting to US.
Mar 03 01:20:48 reMarkable xochitl[240]: 01:20:48.914 rm.epaperkeyboardhandler setting US keymap 293 147
Mar 03 01:20:48 reMarkable xochitl[240]: 01:20:48.915 rm.epaperkeyboardhandler numlock=0 , capslock=0, scrolllock=0
Mar 03 01:20:48 reMarkable xochitl[240]: 01:20:48.915 rm.epaperkeyboardhandler Input locale setting has changed, updating the key map.
Mar 03 01:20:48 reMarkable xochitl[240]: 01:20:48.915 rm.epaperkeyboardhandler Read a langCode of  ""
Mar 03 01:20:48 reMarkable xochitl[240]: 01:20:48.916 rm.epaperkeyboardhandler No keymap set by QT settings or firmware, defaulting to US.
Mar 03 01:20:48 reMarkable xochitl[240]: 01:20:48.916 rm.epaperkeyboardhandler setting US keymap 293 147
Mar 03 01:20:48 reMarkable xochitl[240]: 01:20:48.918 rm.epaperkeyboardhandler numlock=0 , capslock=0, scrolllock=0
Mar 03 01:20:50 reMarkable xochitl[240]: 01:20:50.681 rm.docworker              -> worker on 1146363d-d2b1-4aa7-acc3-a808c99ebbbe now running
Mar 03 01:20:50 reMarkable xochitl[240]: 01:20:50.745 rm.docworker                 loaded pageId="ce1026cd-21ab-4360-b18f-11ecf32a4fe1" - no file found (loadLinesForPageUnprotected /usr/src/debug/xochitl/override+gitAUTOINC+bfef6a8c35-r0/git/src/worker/src/documentworker.cpp:1917)
Mar 03 01:20:51 reMarkable xochitl[240]: 01:20:51.041 rm.docworker              -> worker on 1146363d-d2b1-4aa7-acc3-a808c99ebbbe now exiting (run /usr/src/debug/xochitl/override+gitAUTOINC+bfef6a8c35-r0/git/src/worker/src/documentworker.cpp:1136)
Mar 03 01:20:51 reMarkable xochitl[240]: 01:20:51.128 rm.docworker              -> worker on f90627d1-d85f-4366-91fc-f1a63bc4d613 now running
Mar 03 01:21:05 reMarkable xochitl[240]: 01:21:05.143 rm.docworker                 loaded pageId="bfa66252-6567-417d-802e-aa00a670b2dc" - no file found (loadLinesForPageUnprotected /usr/src/debug/xochitl/override+gitAUTOINC+bfef6a8c35-r0/git/src/worker/src/documentworker.cpp:1917)
Mar 03 01:21:05 reMarkable xochitl[240]: 01:21:05.849 rm.docworker              -> worker on f90627d1-d85f-4366-91fc-f1a63bc4d613 now exiting (run /usr/src/debug/xochitl/override+gitAUTOINC+bfef6a8c35-r0/git/src/worker/src/documentworker.cpp:1136)

sync log

Mar 03 01:09:35 reMarkable systemd[1]: Started reMarkable Document Sync.
Mar 03 01:09:36 reMarkable sync[243]: Lock in temp location
Mar 03 01:09:36 reMarkable sync[243]: Installing crash handler
Mar 03 01:09:36 reMarkable sync[243]: installed crash handler
Mar 03 01:09:36 reMarkable sync[243]: Running service...
Mar 03 01:21:06 reMarkable sync[243]: rm.synchronizer.tree:  - time consuming hash of "f90627d1-d85f-4366-91fc-f1a63bc4d613.pdf" took 551.601
397ms
Mar 03 01:24:04 reMarkable sync[243]: rm.synchronizer.tree:  - time consuming hash of "f90627d1-d85f-4366-91fc-f1a63bc4d613.pdf" took 547.169
453ms
nemunaire commented 1 year ago

There is a new GET request sent to rmfakecloud: /discovery/v1/endpoints Currently it returns the HTML of the UI.

ddvk commented 1 year ago

thanks. I ll update my device at some point

daniel-naegele commented 1 year ago

When can we expect the docker image with the fix? Btw thank you for fixing this so fast, this is why Open Source can be awesome, 2 days from bug report to PR and Merge is absolutely insane.

ddvk commented 1 year ago

uh oh, i was afraid to bump the version as i updated a bunch of dependencies ;)