awebre / la-historical-markers

LA Historical Markers is an iOS and Android app for exploring Louisiana's Historical Markers. The mobile app is built in Expo and the back-end is a combination of Azure Functions, MSSQL, and Azure Storage.
MIT License
2 stars 0 forks source link

OCR Images And AutoFill Title/Description #55

Open awebre opened 3 years ago

awebre commented 3 years ago

We should be able to use a cloud service like the Google Vision API or the Azure Computer Vision API to get text from the images of the photos.

The workflow would be something like: Take Photo -> User Hits "Next" -> Upload Photo to Blob Storage -> Send off for OCR with Blob Url-> Prefill Title/Description with OCR results This would require a slight refactor so that images get uploaded and processed before the user edits the Title/Description and submits. Alternatively, we could skip the upload photo step and just send the photo directly to the OCR API? (Not sure what we gain/lose by this.)

Things To Evaluate:

awebre commented 1 year ago

On iOS this is pretty much handled already thanks to the "enableLiveTextInteractions" option of the Expo Image component. That honestly makes it a little more difficult to justify the cost of running a service specifically for this. I think I'm going to move this out of the 1.5 Release for now.