search

Stavdel / CHARLIE-AI

Open-source AI voice assistant project designed to provide a user-friendly, efficient, and continuously learning conversational interface. By leveraging advanced natural language processing (NLP) techniques, machine learning algorithms, and heuristic approaches, CHARLIE-AI aims to deliver a seamless and intuitive user experience.
MIT License
2 stars 1 forks source link

Implement a Note-Taking Feature for Charlie Using Image-to-Text Conversion [Develop notetaker.py] #2

Open Stavdel opened 7 months ago

Stavdel commented 7 months ago

Hey developers! As we continue to add functionality to Charlie, I have an idea to implement a note-taking feature that allows users to send images of their notes, which are then converted into text and stored locally on their computers in a specific file based on user input.

Digital note-taking has become increasingly popular, enabling users to save their notes on their computers for long-term use. Some popular notebooks being sold have a small QR code watermark in the bottom corner, allowing users to scan their notes into a PDF and save them on their computers. This is a neat feature, but it is often limited to individual brands and their products. Many notebooks lack this functionality.

Since Claude 3 has the ability to understand text from an image, we could utilize this feature to save the extracted text into a file and store it on the user's computer. I believe this would be a great first issue and learning opportunity, which would also be helpful to users.

Here are some key points to consider:

  1. Allow users to specify the file path as a parameter.
  2. Send the image to Claude 3 for processing.
  3. Claude 3 returns the text it reads from the image as its response.
  4. Determine the context of the message and generate a file name that complies with file naming conventions on all operating systems.
  5. Search the directory specified in the file path, read all directory names within file path; recursively determine if the file belongs in an already created directory.
  6. If no matching directory is found, create a new one.

Relevant links:

Claude 3 Vision Documentation: https://docs.anthropic.com/claude/docs/vision
Example Video: https://www.youtube.com/watch?v=bARtbGcJsI0

If you're interested in getting assigned to this issue then leave a comment and I will assign you so we can avoid a conflict.

Stavdel commented 7 months ago

For more information on reading and writing files to your computer check out the python OS module:

https://docs.python.org/3/library/os.html#module-os

byhringjstudent commented 7 months ago

Hello!

I would like to help with this. Is there anything you need from me?