Does rmfakecloud inhibit reMarkable connect features like writing to text OCR?

[jwest75674]

Does rmfakecloud inhibit reMarkable connect features like writing to text OCR?

[murchu27]

It does indeed! rmfakecloud supports the endpoints that the tablet requests when converting handwriting to text, and makes a call to the myScript Handwriting recognition API. You just need your own application key and HMAC (not sure what that stands for).

Just make an account there, and you'll be able to generate an application key and a HMAC, which you can pass to rmfakecloud as environment variables.

[Myridium]

Just a comment and question: is this the same backend that reMarkable themselves use? The website says that LaTeX is supported. I'm extremely interested in this. Much more so than text conversion. Could we get LaTeX handwriting support with rmfakecloud one day?

See https://developer.myscript.com/math and https://webdemo.myscript.com/views/math/index.html for a demo page. Unfortunately the math conversion is a harder problem than text conversion, because mathematical expressions contain little to no redundancy (unlike the written language), formatting/layout is less restrictive, and usually context would help a human reader understand the expressions. Example of poor conversion: https://i.imgur.com/hdfWabj.png I think the future of LaTeX handwriting conversion will probably have to leverage context-dependent interpretation, with domain-specific algorithms for different areas of mathematics. (e.g. the linked equation is very familiar and even elementary to quantum field theorists; there is no doubt what each of the symbols is).

Anecdotally, I have never taken handwriting recognition very seriously as even a few mistakes in the conversion cost a lot of time in correcting. But I tried this out with my usual, half-rushed cursive writing and I'm taken aback by how accurate it is. Things have improved a lot in recent years, I guess. Only thing it got wrong in a page of notes was "Krein --> Krim" (the handwriting is clearly 'Krein'). It even handled itemized lists correctly.

I would like to see more control over the handwriting conversion. Example: a button in the reMarkable interface to convert a page or page(s) to plaintext or markdown, by uploading to the rmfakecloud server which does the conversion, then on the reMarkable it gives you a memorable identifier (think diceware, e.g. staple-correct-battery-horse) and you can navigate there on your rmfakecloud to get the markdown or plaintext file.

[jwest75674]

Since we're making feature requests here: I am chipping away at an endgoal of keyword detection --> CRM like task creation. While I am making lots of progress, I found a stumbling block in that there does not appear to be a method to automatically ensure that all of my notes are converted to text. I currently have to rememeber to convert it myself in my RM, making the text then available via SSH.

Some config file or settings toggle enabling automaticly convert all notes to text would be a hugely useful feature for text-based-automation use-cases like my own.

[Myridium]

Since we're making feature requests here: I am chipping away at an endgoal of keyword detection --> CRM like task creation. While I am making lots of progress, I found a stumbling block in that there does not appear to be a method to automatically ensure that all of my notes are converted to text. I currently have to rememeber to convert it myself in my RM, making the text then available via SSH.

Some config file or settings toggle enabling automaticly convert all notes to text would be a hugely useful feature for text-based-automation use-cases like my own.

Can you do this with a Cron job that does docker exec to run commands in the rmfakecloud container?

[ddvk]

a while ago I made a standalone cmd https://github.com/ddvk/rmapi-hwr which can output latex