Machine Translation TFLite Models

[tulasiram58827]

Hi all, From past few weeks with the help of @sayakpaul I worked on creating TFLite models for Text Detection and Recognition. I have also created a Notebook to do end to end OCR inference with a choice to select CRAFT or EAST as text detector and Keras OCR as recognition engine. Thanks to TFLite team for making on device OCR possible.

Although OCR itself is very good use case. But it will be really useful if we extend the OCR to Machine Translation. I really excited to see end to end mobile application for Image translation especially in the context of India(where there are 23 official languages). I will be working on this and will be adding PR to add the project in INPROGRESS section soon.

I am also thinking to extend the OCR to TTS(Text to Speech) where it can be to people of low vision or no vision. I am happy to collaborate on this project if anyone or interested to work.

@sayakpaul you can tag anyone if they may be interested to collaborate in TTS Project.

CC : @khanhlvg

[sayakpaul]

Tagging in @margaretmz and @farmaker47.

[khanhlvg]

FYI:

• ML Kit has a Translation API that runs on-device. You may want to compare it with other open-source Machine Translation models and provide an insight on how their performance are compared to each other.
• TensorFlowTTS is a Text-To-Speech engine by the community and it supports conversion to TFLite.

[tulasiram58827]

Thanks @khanhlvg for references.

• Yes we will compare it.
• This is actually gold mine. Thank you so much for sharing. I am excited to see integration of OCR models with this TTS .

[sayakpaul]

For TTS, we have this too - https://github.com/mozilla/TTS.