Readwise error 400 on Clara 2E

johnnyfleet commented 1 year ago

Hi there - I just tried to sync for the first time my Kobo Clara 2E using v.1.3.4.

The device successfully is recognised and identifies 300 highlights to sync. When I choose to sync I then get an error message saying There was a problem sending your highlights: received a non-200 status code from Readwise: code 400.

Below is the logs if that helps.

{"level":"info","msg":"Logger should be initialised now","time":"2023-06-02T18:20:44+12:00"}
{"level":"info","msg":"Backend is about to start up","time":"2023-06-02T18:20:44+12:00"}
{"kobos_found":1,"level":"info","msg":"Detected one or more Kobos","time":"2023-06-02T18:20:44+12:00"}
{"device_id":"00000000-0000-0000-0000-000000000386","level":"info","msg":"Found an attached device","time":"2023-06-02T18:20:44+12:00"}
{"kobos_found":1,"level":"info","msg":"Detected one or more Kobos","time":"2023-06-02T18:20:45+12:00"}
{"device_id":"00000000-0000-0000-0000-000000000386","level":"info","msg":"Found an attached device","time":"2023-06-02T18:20:45+12:00"}
{"batch_count":1,"highlight_count":0,"level":"info","msg":"Successfully parsed highlights","time":"2023-06-02T18:20:49+12:00"}
{"level":"error","msg":"Received a non-200 response from Readwise","response":"{\"non_field_errors\":[\"No data provided\"]}","status_code":400,"time":"2023-06-02T18:20:50+12:00"}

System Details

Version: v1.3.4
Platform: windows
Architecture: amd64
Running in a virtualised Windows 10 Guest VM with USB passthrough

johnnyfleet commented 1 year ago

Now I've looked at other issues this looks related to https://github.com/marcus-crane/october/issues/82

johnnyfleet commented 1 year ago

Interestingly it says in the logs (If I read right) that the highlights number is 0, but on the GUI is says there are 300+

marcus-crane commented 1 year ago

Hey @johnnyfleet,

Just to confirm, are these highlights from sideloaded books, store purchased books or both?

johnnyfleet commented 1 year ago

Side loaded and books from Libby.

On Fri, 2 Jun 2023, 18:34 Marcus Crane, @.***> wrote:

Hey @johnnyfleet https://github.com/johnnyfleet,

Just to confirm, are these sideloaded books or store purchased books?

— Reply to this email directly, view it on GitHub https://github.com/marcus-crane/october/issues/86#issuecomment-1573226206, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADL2YS2ZPJHWQZTYT3M4N5TXJGCP5ANCNFSM6AAAAAAYX35E6I . You are receiving this because you were mentioned.Message ID: @.***>

marcus-crane commented 1 year ago

Hmm, that is a bit strange since sideloaded books shouldn't have any trouble. I can't say I've ever tried Libby books (I didn't know they could be highlighted).

If you're up for forwarding me a copy of your Kobo database (via email), I can run some tests and see where it's getting stuck. There have been a few issues in the past like highlights exceeding a certain number of characters (which was patched) and other things that are hard to replicate or expect.

As always, the one caveat you should know up front is that if you're logged into your Kobo account, your Kobo database does have a table that contains a session token that could be used to access your account. It doesn't contain your password or anything but you should be aware before ever sending that database anywhere (and definitely don't send it anywhere publicly)

Anyway, if you're fine knowing that, you're welcome to forward it to october@utf9k.net and I'll see what I can replicate

marcus-crane commented 1 year ago

Hey @johnnyfleet,

I've just released v1.4.0 which fixes some bugginess with how highlights were being queried and this may fix the issue you're running into.

johnnyfleet commented 1 year ago

Thanks a lot @marcus-crane - I'll give it a try shortly. It is possible to package a windows executable version? There doesn't seem to be one in the 1.4.0 release options right now.

marcus-crane commented 1 year ago

Hey @johnnyfleet, there should be a Windows version available shortly. It turns out that I accidentally released the version as v.1.4.0 instead of v1.4.0 which caused the Windows build to fail as that isn't a valid version format

johnnyfleet commented 1 year ago

Excellent - thank you for your help. That has made an improvement but some observations still.

Good news, I was able to upload if I enabled the option of uploadng higlights from store bought books. This seems to have solved sycing Libby books.
Confirmed and the highlights are in readwise - 274 highlights.
Oddly the total highlights didn't seem to match. The main meny showed the Kobo Clara 2E has 343 highlights (343 official). However when I sync the pop up messgae says 274 were uploaded, which matches readwise. I wonder why different numbers.
If I disable the opton of "uploading highlights from store bought books" I then get the same errors as originally *non-200 error"

johnnyfleet commented 1 year ago

If its helpful, here are 2 sets of the logs:

With the uploadng highlights form store bought books unselected

{"level":"info","msg":"Logger should be initialised now","time":"2023-06-03T21:39:22+12:00"}
{"level":"info","msg":"Backend is about to start up","time":"2023-06-03T21:39:22+12:00"}
{"kobos_found":1,"level":"info","msg":"Detected one or more Kobos","time":"2023-06-03T21:39:22+12:00"}
{"device_id":"00000000-0000-0000-0000-000000000386","level":"info","msg":"Found an attached device","time":"2023-06-03T21:39:22+12:00"}
{"kobos_found":1,"level":"info","msg":"Detected one or more Kobos","time":"2023-06-03T21:39:22+12:00"}
{"device_id":"00000000-0000-0000-0000-000000000386","level":"info","msg":"Found an attached device","time":"2023-06-03T21:39:22+12:00"}
{"batch_count":1,"highlight_count":0,"level":"info","msg":"Successfully parsed highlights","time":"2023-06-03T21:39:31+12:00"}
{"level":"error","msg":"Received a non-200 response from Readwise","response":"{\"non_field_errors\":[\"No data provided\"]}","status_code":400,"time":"2023-06-03T21:39:32+12:00"}

With the uploadng highlights form store bought books selected

{"level":"info","msg":"Logger should be initialised now","time":"2023-06-03T21:38:38+12:00"}
{"level":"info","msg":"Backend is about to start up","time":"2023-06-03T21:38:38+12:00"}
{"kobos_found":1,"level":"info","msg":"Detected one or more Kobos","time":"2023-06-03T21:38:38+12:00"}
{"device_id":"00000000-0000-0000-0000-000000000386","level":"info","msg":"Found an attached device","time":"2023-06-03T21:38:38+12:00"}
{"kobos_found":1,"level":"info","msg":"Detected one or more Kobos","time":"2023-06-03T21:38:38+12:00"}
{"device_id":"00000000-0000-0000-0000-000000000386","level":"info","msg":"Found an attached device","time":"2023-06-03T21:38:38+12:00"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"Your Pal Fred","volume_id":"41776a91-6beb-40bf-9cc2-782523870a1d"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"Ranger Rick: I Wish I Was a Lion","volume_id":"79104369-f642-49ec-b91a-0d0e26084173"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"Ranger Rick: I Wish I Was a Lion","volume_id":"79104369-f642-49ec-b91a-0d0e26084173"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"Icky Ricky #4: The Hole to China","volume_id":"91a841e0-5570-4b81-a2b8-7045a31b5ba9"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"Icky Ricky #4: The Hole to China","volume_id":"91a841e0-5570-4b81-a2b8-7045a31b5ba9"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"level":"warning","msg":"Found an entry with neither highlighted text nor an annotation so skipping entry","time":"2023-06-03T21:38:44+12:00","title":"The First 90 Days, Updated and Expanded","volume_id":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8"}
{"batch_count":1,"highlight_count":275,"level":"info","msg":"Successfully parsed highlights","time":"2023-06-03T21:38:44+12:00"}
{"batch_count":1,"level":"info","msg":"Successfully sent bookmarks to Readwise","time":"2023-06-03T21:38:46+12:00"}
{"book_count":2,"level":"info","msg":"Successfully retrieved books from Readwise API","time":"2023-06-03T21:38:46+12:00"}
{"cover":"b03ea6ad-b979-460b-b275-19a2b2e4cdb8","error":"open E:/.kobo-images/120/156/b03ea6ad-b979-460b-b275-19a2b2e4cdb8 - N3_LIBRARY_FULL.parsed: The system cannot find the path specified.","level":"warning","location":"E:/.kobo-images/120/156/b03ea6ad-b979-460b-b275-19a2b2e4cdb8 - N3_LIBRARY_FULL.parsed","msg":"Failed to load cover. Carrying on","time":"2023-06-03T21:38:46+12:00"}
{"cover":"91a841e0-5570-4b81-a2b8-7045a31b5ba9","error":"open E:/.kobo-images/73/147/91a841e0-5570-4b81-a2b8-7045a31b5ba9 - N3_LIBRARY_FULL.parsed: The system cannot find the path specified.","level":"warning","location":"E:/.kobo-images/73/147/91a841e0-5570-4b81-a2b8-7045a31b5ba9 - N3_LIBRARY_FULL.parsed","msg":"Failed to load cover. Carrying on","time":"2023-06-03T21:38:47+12:00"}
{"level":"info","msg":"Shutting down. Goodbye!","time":"2023-06-03T21:39:15+12:00"}

johnnyfleet commented 1 year ago

If it's helpful ill see if I can send a copy of db to see if there is some way to distinguish Libby books from Kobo store bought ones.

I could see, if possible, it would be desirable to upload those regardless of the toggle for uploading store bought books.

If the Kobo official integration gets ironed out it may be good to then have a choice to turn off the feature. But I think Libby doesn't sync any other way officially from Kobo ereaderbso good to send either way.

Testing v1.4.0 it seems to only work if the syncing of store bought is enabled.

marcus-crane commented 1 year ago

If it's helpful ill see if I can send a copy of db to see if there is some way to distinguish Libby books from Kobo store bought ones.

If you're able to, that'd be the easiest way forward since it allows me to replicate exactly what you're facing. I've got a test Readwise account that I upload into in order to replicate issues and test out bulk upload limits etc.

It may be that Libby highlights have a slightly different structure in the database but I haven't checked.

The issue is likely related to

Found an entry with neither highlighted text nor an annotation so skipping entry

where some highlights I believe use a third column in the database.

Off the top of my head, there is Text, Annotation and a third one called something like UserContext and I'm not entirely sure what the criteria is for a note to end up in there but likely October needs to upload those as well to resolve the issue.

jccpalmer commented 1 year ago

Just wanted to chime in that I'm on v1.5.0 on an M1 Mac and I had this issue on my Libra 2 until I checked "Upload highlights from store-bought books," even though I sync all of mine through Calibre Web. So not sure what in there fixed the issue, but it worked.

marcus-crane / october

Readwise error 400 on Clara 2E #86

With the uploadng highlights form store bought books unselected

With the uploadng highlights form store bought books selected