search

JustinShenk / fer

Facial Expression Recognition with a deep neural network as a PyPI package
MIT License
351 stars 80 forks source link

Issue while using audio=True parameter in analyze function #64

Open AshwiniN91 opened 7 months ago

AshwiniN91 commented 7 months ago

Testing a video file having audio in it.

I have followed the pre-requisite of installing: !pip install ffmpeg moviepy

Tried comparing the output using two approaches:

  1. include_audio = True Screenshot_1
Screenshot_2
  1. include_audio = False Screenshot_4
Screenshot_3

Could you confirm if the observed differences in emotion detection results are expected when comparing video files with and without audio? Shouldn't the presence or absence of audio have no impact on the percentage of emotions detected?

Thanks, Ashwini

JustinShenk commented 7 months ago

Yes, that should have no impact. Please let me know if you find a solution.

On Tue, Apr 16, 2024 at 11:26 AshwiniN91 @.***> wrote:

Testing a video file having audio in it.

I have followed the pre-requisite of installing: !pip install ffmpeg moviepy

Tried comparing the output using two approaches:

  1. include_audio = True

Screenshot_1.png (view on web) https://github.com/JustinShenk/fer/assets/69236986/c81b46c0-95e0-45a4-9cab-dfa8cde8b0f3 Screenshot_2.png (view on web) https://github.com/JustinShenk/fer/assets/69236986/1f7cc9a1-2f99-4db5-89ed-48ffc4d7f5fd

  1. include_audio = False

Screenshot_4.png (view on web) https://github.com/JustinShenk/fer/assets/69236986/c2e18ded-9c54-4477-8585-107b3a6c04d7 Screenshot_3.png (view on web) https://github.com/JustinShenk/fer/assets/69236986/633528fc-15e8-493f-a103-1e2d488738c9

Could you confirm if the observed differences in emotion detection results are expected when comparing video files with and without audio? Shouldn't the presence or absence of audio have no impact on the percentage of emotions detected?

Thanks, Ashwini

— Reply to this email directly, view it on GitHub https://github.com/JustinShenk/fer/issues/64, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACOLMZFM3DAZ7KI6ACUYEX3Y5U7J3AVCNFSM6AAAAABGJSZINSVHI2DSMVQWIX3LMV43ASLTON2WKOZSGI2DMMZTGUYTGMQ . You are receiving this because you are subscribed to this thread.Message ID: @.***>

AshwiniN91 commented 7 months ago

Thank you for your inputs. I'll keep you updated if I come across a solution.