| Audio-Aware Mobile Robot Navigation（SIM） |
Learning to Listen and Move: An Implementation of Audio-Aware Mobile Robot Navigation in Complex Indoor Environment |
|
RTAB-Map for agent position,Separately training autoencoder(denoise)+SIM(get relative x,y),ROS navigation stack for global path planning. |
|
[Visual Acoustic Matching (CVPR2022)]() |
https://github.com/facebookresearch/visual-acoustic-matching |
|
|
Few-Shot Audio-Visual Learning of Environment Acoustics |
|
RIR prediction.Infer arbitrary RIRs having observed only a small number of echoes and images in the space. |
| VIDA |
Learning Audio-Visual Dereverberation(arxiv2022) |
https://github.com/facebookresearch/learning-audio-visual-dereverberation |
achieve dereverberation from both visual and audio and test the method in asr. |
