microsoft / hack-together-dotnet

HackTogether: The Microsoft .NET 8 Global Hack | Register, Hack, Win
MIT License
289 stars 48 forks source link

DocumentsAI - AI powered DMS #68

Open dhornet87 opened 10 months ago

dhornet87 commented 10 months ago

Project name

DocumentsAI

Description

Protoype for a DMS with OCR and ChatGPT Analysis. Works with .NET Aspire. EF Core Database and ASP.Net MVC Architectur.

In the first Stage you can upload .tiff files which get analysed and categorized by ChatGPT. Also ChatGPT generates some Tasks for this document. For example "pay an invoice".

Also you can edit/delete/add the ChatGPT generated Metadata and view the uploaded Document in a little Preview.

I tried to solve a personal problem, which i guess do have others too. Even everything is nowadays online and a good part of our lives take place in this space, there a still sooo many paper documents which you get and need to store and sort and take care of - especially in countrys like Germany (where i live). So why not ask ChatGPT for some help. I always wanted to create my own DMS and now with the support of ChatGPT i can upload documents, persist them in a Database and even get some Metadata and ToDos out of it.

So it works as follows: You upload a .tiff file. An OCR (Tesseract) scans the document and returns a representation of this document as a string. This string is then directed to ChatGPT with a prompt to categorize this document and try to create some tasks.

Afterwards the document is saved in an Ms SQL Database (EF Core as ORM) which is hosted in a Docker-Container. For this demo i didnt create an additional web endpoint for handling all DB Queries, but i guess i could do this in the future. Then you can add the Categories and Metadata, which were generated by ChatGPT and also view the document.

As already mentioned this is more a proof-of-concept at this stage but i will definitely work on this dms in the future!

Project Repository URL

https://github.com/dhornet87/MVCAI/

Project video

https://github.com/dhornet87/MVCAI/assets/59484759/d5390aa9-3715-48d8-bfe0-09978eaa9149

Team members

Malte