New Proposal and Stuff to do - Phase 2

ghost commented 10 years ago

Updated. As Marcell suggested, it makes more sense to have the person who the detection does the training as well.

@mvcisback @ffaghri1

So, since the first phase was a failure, here is a new list. It would be super nice if everyone pick one of these to work on and put the matlab-function code for it.

Face Detection ( Detect faces in a video frame, base on the dimension of the detected face you might want to disregard them and only capture the good ones. Then you need to resize them to a fix size and save them into a mat file of what ever dimension. e.g. h_w_3*num_faces.) . Predict a model and include a .mat file for raw data.
Voice activity detection ( detect when there is a voice, capture the index and find the corresponding frame number. Save the voice for say 10 sec long when the speaker is talking. Make sure there is no silence in the voice. Save voices for each frame. e.g. Frame 10 voice : 1_300 samples Frame 11: 1_300...) . Predict a model and include a .mat file for raw data.

(Face detection person should talk to the voice activity person, there are common parameters that both function should have).

Look into 3D Audio/source separation. Evaluation base on face and speech and combining them after having the models.
It would be nice to have a GUI if you've done it before want to work on it.

mvcisback commented 10 years ago

@ramili could you discuss how the first phase was a failure (I think it'd be good to include in our final report)

mvcisback commented 10 years ago

So the 3rd bullet falls under #7. Made an issue for voice activity detection #17 Also made an issue for face detection #18

ghost commented 10 years ago

Let me go over the phase 1 with you when we meet. We should def include it in the final report. Let's have everyone pick a topic here and then we refer to subtopics once we know who is doing what.

mvcisback commented 10 years ago

@ramili I suppose I could take a shot at voice activity detection.

ghost commented 10 years ago

Super! I'll let Faraz pick the other one, and I'll do whatever is left.

mvcisback commented 10 years ago

This is very similar to phase 2:

https://courses.engr.illinois.edu/ece417/sp2014/MP3.shtml

mvcisback / SSLVC

New Proposal and Stuff to do - Phase 2 #16