search

pulsejet / memories

Fast, modern and advanced photo management suite. Runs as a Nextcloud app.
https://memories.gallery
GNU Affero General Public License v3.0
3.21k stars 87 forks source link

Built-in face and object recognition #980

Open alfwro13 opened 10 months ago

alfwro13 commented 10 months ago

First of all I would like to say thank you for making this app. I have just discovered it after lengthy search and trying many self-hosted solutions. There are many good solutions (the best one that kind of works with NC is LibrePhotos) but as I am already using NC for many of my needs, memories app fits perfectly without the hassle of installing and maintaining additional software package. Thank you.

Is your feature request related to a problem? Please describe. Now that the recognise app is effectively being abandoned by NC team and so buggy that is hardly usable (just wasted a couple of days trying to get it working and constantly hitting problems with unhandled exceptions etc.) it would be beneficial to have face / object recognition built-in this app

Describe the solution you'd like Face and object recognition built-in the Memories app. Not sure how feasible would be using https://github.com/ageitgey/face_recognition for face recognition and https://github.com/scikit-learn-contrib/hdbscan for face clustering

Describe alternatives you've considered There aren't any good alternatives at the moment. Photo management is Nextcloud achilles' heel at the moment.

RikkiBC commented 10 months ago

Can you please provide a link of Recognise "effectively being abandoned by NC team"? I hadn't heard of this or had any issues with Recognise myself yet...

alfwro13 commented 10 months ago

Sure here it is https://github.com/nextcloud/recognize/discussions/779

pulsejet commented 10 months ago

Possible solutions here are:

  1. Fix / improve the recognize app (most preferable)
  2. Fork the recognize app and redo the ML parts
  3. Create a new app for recognition (Memories already offers integrations with Recognize and Face Recognition, adding a third app is theoretically possible)

I've no experience / expertise in the above area, so someone else needs to take this up.

Adding this to Memories itself would defeat the modularity and flexibility, and force a lot of unnecessary dependencies on folks who are uninterested in these features. There's literally zero advantage to doing this in Memories over a separate app except saving one extra click to install a separate app in the app store.

rhatguy commented 10 months ago

This is the reason so many people (including myself) advocate for storing (and reading) face metadata in either XMP sidecar format or inside the image (similar to how GPS or create date is stored). In the case of a standardized format for metadata, that would allow users to choose what app they want to use to generate the metadata, and move on from Recognize if they were unhappy with its performance or support while still using Memories. Memories is currently hard linked to Recognize (or facerecognition) for a lot of people.

127

RikkiBC commented 10 months ago

Sure here it is nextcloud/recognize#779

Thank you for the link.

Nextcloud GmbH is not moving away from facial (or any other type of) recognition as a feature and we're not planning to replace recognize with something else. We are also not "dropping support for recognize".

This doesn't mean that we are abandoning this app (if we did, I'd make that clear here). ... We are not abandoning this app and it is still safe to use and rely on it.

Glad to see that the "effectively abandoning the app" wording isn't correct, though I do understand the worry about the lack of new features being focused on.