search

10up / classifai

Supercharge WordPress Content Workflows and Engagement with Artificial Intelligence.
https://classifaiplugin.com
GNU General Public License v2.0
572 stars 53 forks source link

Generate post text from hand-written notes #323

Open jeffpaul opened 2 years ago

jeffpaul commented 2 years ago

Is your enhancement related to a problem? Please describe. Paper Website does a nice job of generating website content from hand-written notes/journals. This seems similarly feasible via open source using various OCR API's available and our friend WordPress, though we'll want to work through the UX to make this as graceful as possible given the WP mobile - to - ClassifAI handoff that'll need to happen.

https://user-images.githubusercontent.com/2818133/148613576-c33b8ab4-3c6b-405e-84c8-ba89efa446fc.mp4

Describe the solution you'd like

Designs UX needs roughly noted above.

Describe alternatives you've considered If we're going to aim to build this feature, the only alternative I can surmise is to try and roll this directly into the WP mobile apps which... I don't know you tell me if that's more optimal?

Additional context Source idea, props @dimensionmedia.

jeffpaul commented 2 years ago

Sharing an in-progress UX flow of an initial / MVP attempt at building this into ClassifAI (admitting that there will be many other possible user flows, but wanting to at least get a basic / most expected flow attempted first to gather feedback before enhancing the user flows further): https://miro.com/app/board/uXjVO1fP4jE=/?share_link_id=639841463424

jeffpaul commented 2 years ago

Props to Jennifer Hicks and Ayanda Mbonambi for the UX research, analysis, and lowfi mockups.

jeffpaul commented 2 years ago

In discussing the base UX case to consider supporting here with @fabiankaegy, we came to the conclusion that having a simple WP Admin page (potentially exposed on the side menu, TBD) that captures images (1-n), sends those out to Azure for processing, and then adds that as text within paragraph blocks in a post/page. The expectation is that this page will be accessed via mobile web on a mobile device such that photos on said device can be uploaded to this WP Admin page. The open question is how best (at least in this base case, initial released version) to get a link to that WP Admin page to a users mobile device (as we're expecting that ClassifAI will have been installed/activated or updated from that users' desktop device and not from mobile).

Keep in mind that we're not trying to support ALL the various users flows that could happen, but a single user flow to gather feedback on the viability of this functionality before expanding user flows.

jeffpaul commented 2 years ago

In discussing this with @dkotter, we could also investigate whether we can inject an icon/link into the WP mobile web view to trigger the image capture flow but neither of us were immediately sure if that was (1) possible and if so (2) how to go about doing that.