search

hoarder-app / hoarder

A self-hostable bookmark-everything app (links, notes and images) with AI-based automatic tagging and full text search
https://hoarder.app
GNU Affero General Public License v3.0
2.44k stars 80 forks source link

[Feature Request] Create Testing dataset and evaluation workflows for AI Tasks #113

Open medo opened 2 months ago

medo commented 2 months ago

The project has a big potential for various AI workflows that can use the saved data to do different useful tasks for users.

To ease the development of different AI workflows and enable collaboration, I suggest creation of different golden test datasets that simulates the behaviour of different users. This will enable eveyone to run experiments on those golden datasets and share results (on jupyter notebooks?)

I think this could be a starting point for developers to showcase different ideas on typical Hoarder data.

kamtschatka commented 1 month ago

Can you elaborate a bit more? I honestly have no idea what you are asking.