search

jakowenko / double-take

Unified UI and API for processing and training images for facial recognition.
https://hub.docker.com/r/jakowenko/double-take
MIT License
1.19k stars 92 forks source link

AWS Rekognition Interest #218

Open jakowenko opened 2 years ago

jakowenko commented 2 years ago

I've been curious to know how well AWS Rekognition stacks up to the other open source detectors and decided to build an online API to support this and allow easy integration on the Double Take side.

My idea was to support Rekognition from within the Double Take API for users who want to use their own AWS account and to also provide an online API hosted by myself that would also provide the same ability.

Implementing it on the Double Take side would look something like this.

detectors:
   rekognition:
        key: xxx-xxx-xxx-xxx # this would be for the hosted version
        aws-access-key-id: xxx-xxx-xxx
        aws-secret-access-key: xxx-xxx-xxx
        aws-region: us-east-1

Pricing from AWS is $0.0010 per image so there will be some costs to consider for those who are interested and in the future that price may change.

Either way, I'm going to build this out for personal use and if there's any others who are interested in trying it out feel free to let me know. If this catches on I will have to figure out automated payments, etc.

thomaschristory commented 2 years ago

Hey there,

So far it works very well, one thing that would be nice to add is sensors with the number of images processed for the month and/or the current cost

Thanks !

jakowenko commented 2 years ago

Hey there,

So far it works very well, one thing that would be nice to add is sensors with the number of images processed for the month and/or the current cost

Thanks !

I like that idea! I'll look into it.

lied commented 1 year ago

For me rekognition works much better than compreface. I would love a counter, how many are processed and a "limit" of pictures to be sent to rekognition would also be nice. If there is like thousand kids for halloween on your door it can be quite cost intensive. ;-)

atv2016 commented 1 year ago

@lied Really? Hmm maybe i should give it a go then. In what way do you feel it has been better?

lied commented 1 year ago

@lied Really? Hmm maybe i should give it a go then. In what way do you feel it has been better?

Compreface tries to put a name to every face it detects. Unknown faces are very rare. At least in my setup. Where AWS is much more reliable.

atv2016 commented 1 year ago

Hmm haven't used it for that long. Does it not put low confidence and no match to faces it doesn't know ? I agree that would be annoying, i'd like to see unknown faces.

Ofcourse recognition you will be dependent on the cloud and pay a little. How much do you pay on average per month if i may ask ?

From: lied @.> Sent: 22 November 2022 05:36 To: jakowenko/double-take @.> Cc: atv2016 @.>; Comment @.> Subject: Re: [jakowenko/double-take] AWS Rekognition Interest (Issue #218)

@liedhttps://github.com/lied Really? Hmm maybe i should give it a go then. In what way do you feel it has been better?

Compreface tries to put a name to every face it detects. Unknown faces are very rare. At least in my setup. Where AWS is much more reliable.

— Reply to this email directly, view it on GitHubhttps://github.com/jakowenko/double-take/issues/218#issuecomment-1323106252, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AEBCFU4AFSSRRTH2QBHMH4LWJRLVJANCNFSM5YLNYWHA. You are receiving this because you commented.Message ID: @.***>

ozett commented 1 year ago

i looked into aws and amazon is offering three face api.

Face Detection Face Search Face Metadata Storage

which one is needed?

MichielvanBeers commented 1 year ago

@ozett where did you find those APIs? I've set this up by 1. configuring a separate user 2. adding the AmazonRekognitionFullAccess policy to that user (or a connected user group) 3. logging in with that user 4. copying the access key id and secret access key from there and 5. pasting that in the configuration of detectors as posted above.

Doing some initial testing now as well, but so far the results are definitely better than CompreFace, so very happy with this integration @jakowenko! :)

atv2016 commented 1 year ago

Did you try with the custom builds for compreface as well? Does it recognise unknown people? I find it’s just not useful as doubletake/compreface recognise known persons but can’t really distinguish well once there is an unknown.

From: MichielvanBeers @.> Sent: 30 January 2023 17:32 To: jakowenko/double-take @.> Cc: atv2016 @.>; Comment @.> Subject: Re: [jakowenko/double-take] AWS Rekognition Interest (Issue #218)

@ozetthttps://github.com/ozett where did you find those APIs? I've set this up by 1. configuring a separate userhttps://docs.aws.amazon.com/IAM/latest/UserGuide/getting-set-up.html#create-an-admin 2. adding the AmazonRekognitionFullAccess policy to that user (or a connected user group) 3. logging in with that user 4. copying the access key id and secret access key from there and 5. pasting that in the configuration of detectors as posted above.

Doing some initial testing now as well, but so far the results are definitely better than CompreFace, so very happy with this integration @jakowenkohttps://github.com/jakowenko! :)

— Reply to this email directly, view it on GitHubhttps://github.com/jakowenko/double-take/issues/218#issuecomment-1409033938, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AEBCFU5QT4W2UOVSQHUXKRTWU73LFANCNFSM5YLNYWHA. You are receiving this because you commented.Message ID: @.***>

MichielvanBeers commented 1 year ago

I'm not sure which custom builds you mean, so I don't think I have tested those yet. If you can point me in the right direction I'm happy to help test!

I've also noticed a difference in the performance in low lighting. Here AWS Rekognition seems to struggle more than CompreFace, though I haven't tested thoroughly yet.

ozett commented 1 year ago

thats the API-Pricing i can see: whats needed to test? group 1 or group 2, or something else?

image

MichielvanBeers commented 1 year ago

Ah, I didn't know that one. Looking at the pricing overview that I came across in my AWS portal, I'd reckon it is the top one, but I'm not 100% sure. The Free tier lets you have 5000 scans per month for free at least, so that is great for testing.

neuhausf commented 1 year ago

Thanks for this great addition. I am currently on the free tier (at least that's what I believe...).

The AWS interface is somewhat over complicated and I don't feel quite comfortable now that my credit card is known....

lied commented 1 year ago

On my aws account I got a mail once I nearly used my monthly free tier amount. Beside that, I don't know if you can setup more beside the normal limits you can apply to your aws billing account amount.

On Sat, Apr 8, 2023, 16:46 Florian Neuhaus @.***> wrote:

Thanks for this great addition. I am currently on the free tier (at least that's what I believe...).

  • Is there a way to see the current usage and limits of the Rekognition-API
  • Is there a way to limit costs per month and disable the API if exceeded?

The AWS interface is somewhat over complicated and I don't feel quite comfortable now that my credit card is known....

— Reply to this email directly, view it on GitHub https://github.com/jakowenko/double-take/issues/218#issuecomment-1500905784, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAEHYM3FMGUDGZDCSSSLCO3XAF227ANCNFSM5YLNYWHA . You are receiving this because you were mentioned.Message ID: @.***>