search

introlab / manyears

ManyEars Sound Source Localization, Tracking and Separation
http://introlab.github.io/manyears
183 stars 90 forks source link

Does this work with other microphone arrays? #2

Open Efreeto opened 7 years ago

Efreeto commented 7 years ago

Hi, this is more of questions than an issue. I'm trying to use my PS Eye microphone array for voice location tracking. Is ManyEars suitable for this task? It seems to support on the 8 USB microphone array set. Also, while building the project, it failed with JACK library not found. Is this an expected error?

doumdi commented 7 years ago

As long as you have 4+ synchronous microphones and ALSA, the algorithm should work. You have to configure the algorithm with the position of the microphones first. For the JACK library, can you be more specific on the error you get please? JACK is not mandatory for ManyEars to work. Also, if you get ManyEars working with the PS Eye, please let us know, we will add the documentation on the wiki. Thanks!

doumdi commented 7 years ago

Modify the file: https://github.com/introlab/manyears/blob/master/manyears-C/RTAudio/CMakeLists.txt and remove find_package(Jack) to avoid this problem.

doumdi commented 7 years ago

Distance between the microphones seems about 3-4 cm in a linear array : https://codelaboratories.com/research/view/ps3-eye-disassembly

It needs to be measured precisely. Try to center the axis in the middle of the camera.

navta commented 7 years ago

Hi, where can I get 8soundsusb?

doumdi commented 7 years ago

You can have a quote by writing to Francois.Michaud@USherbrooke.ca. Thanks.

zhaoforever commented 7 years ago

Is GLOBAL_MICSNUMBER the only parameter need to be modified? I tried 6 microphones but it does not work.Thanks

zilmano commented 6 years ago

Hi, I have too tried to make many ears working with PS Eye, without success so far. My doubt is that PS Eye has 4 microphones which are spaced tight to each other, with 2 cm difference between the microphones. This is much smaller than the distance suggested in the FAQ on sourceforge, which suggests 10-40cm. I wanted to ask if you think ManyEars wuold be capable of working with microphone array with only 2cm spacing between the microphones? Would appreciate your advice!

FrancoisGrondin commented 6 years ago

Hi,

Indeed the small spacing might be a problem. I suggest you have a look at our new library ODAS witch works fine with small microphone array such as the ReSpeaker. The library is in dev but a first release is expected in a few weeks.

Can you tell me what are the exact positions of the microphone? Given the origin is at the center of mass of the microphone array, can you provide me with the coordinates? Moreover, if you can record a RAW file with four channels, I could prepare a configuration file for ODAS that should allow the library to work with the PS Eye.

Cheers!

François

zilmano commented 6 years ago

Hi François,

Thank you for your response, I would definitely like to check out your new library! Having the localization capabilities you have developed working with PS Eye microphone would be an asset. The PS Eye is affordable, doesn't require a dedicated sound card, and easy to acquire, thus making it a good and practical option for prototype and non-prototype robots.

Apologies for my delayed response as I have been away from the lab. The exacts coordinates (x y z) of the four microphones would be (-0.03 0.00 0.00) (-0.01 0.00 0.00) (0.01 0.00 0.00) (0.03 0.00 0.00), with the array center at (0,0,0). The distance is in meters.

I have recorded two sample raw files with 4 channels, rate of 48000, and in the format S16_LE. ( To play with alsa: "aplay test_ps_eye_1.raw -f S16_LE -c4 -r48000") The files record speakers with different distances from the array, minimal noises, and an empty room. The distance information is specified in the recordings themselves. I have sent the files to you and the mail thread, please let me know if you haven't received them from some reason.

If something needs to be changed with the files, like increased gain, a different frequency, more detailed speaker location information, or any other parameters, I would be happy to record more. And If I can be of help in any other way, please let me know.

Thank you!

Oleg