A Battle of Text Detectors for Mobile Deployments: CRAFT vs. EAST | Sayak Paul

[utterances-bot]

A Battle of Text Detectors for Mobile Deployments: CRAFT vs. EAST | Sayak Paul

This post compares two Deep Learning-based text detectors CRAFT and EAST with respect to deployment-specific requirements.

https://sayak.dev/optimizing-text-detectors/

[Hankkin]

where can I find the demo code which craft & east model can be demonstrated on android or IOS

[sayakpaul]

Both are text detectors, I am not sure how you could combine them. At their core, both are object detection models, so I believe you could refer to any mobile application code that implements object detection with TensorFlow Lite.

[Hankkin]

Not combine them，I want to run the application demo. But I could not find the link of demo code. I saw farmaker47‘s github，but the project of 'ocr_keras' is empty. "https://github.com/farmaker47?tab=repositories"

[litongbreeze]

May I have your code in which both east and craft can runned on android and IOS?

[sayakpaul]

We currently do not have a demo application for these models. @farmaker47 is working on it. Stay tuned.

You can refer to this Notebook by @tulasiram58827 that shows an end-to-end OCR example in Python using these models.

[NisonSunnyC]

@tulasiram58827 I am trying to create an android app using below added models. https://tfhub.dev/s?deployment-format=lite&q=Text%20Recognition How can i convert the output array to Text ?

[sayakpaul]

@NisonSunnyC we are not Android experts.

I am tagging @farmaker47 as he is one of the best all-around Android and ML folks I know out there who can help you.

[farmaker47]

@NisonSunnyC Each element in the array corresponds to a position (line) of a text file that comes with the .tflite file together. Think of it like below: Position 1 Value 0 Position 2 Value 1 Position 3 Value 2 ..... So word 'book' will be like = [12, 25, 21,21,-1,-1,-1,-1.........] Search at the application for the text file to see the values. For a reference watch this.

[sahasraa]

hi @sayakpaul, could you please share me the inference scripts for dynamic range tflite of EAST

[sayakpaul]

https://github.com/sayakpaul/Adventures-in-TensorFlow-Lite/blob/master/EAST_TFLite.ipynb

[renjithsasidharan]

@sayakpaul is there a demo code for implementation of EAST/CRAFT on android? The code referenced by @farmaker47 is for text recognition using CRNN.

[sayakpaul]

Not that I know of.

[renjithsasidharan]

Just found this, https://github.com/tensorflow/examples/tree/master/lite/examples/optical_character_recognition/android EAST for detection and keras-ocr (CRNN) for recognition.

How did you miss this? You are even credited here: https://blog.tensorflow.org/2021/09/blog.tensorflow.org202109optical-character-recognition.html 😄