search

facebookresearch / sound-spaces

A first-of-its-kind acoustic simulation platform for audio-visual embodied AI research. It supports training and evaluating multiple tasks and applications.
https://soundspaces.org
Creative Commons Attribution 4.0 International
320 stars 55 forks source link

Topdown heatmap viewer #42

Open aluo-x opened 3 years ago

aluo-x commented 3 years ago

I noticed in your paper you presented figures (fig 1 & fig 2) for topdown & side view visualizations for sound pressure.

I want to visualize a similar heatmap using sparse samples & bilinear interpolation. I was curious if you can share what tools you use to generate the visualizations (for topdown & side view respectively).

Was it just blender?

ChanganVR commented 3 years ago

One of my collaborators made this figure and he used the MeshLab tool to load the mesh and grid points.

Here are a bit more details from thim:

  1. The color of each grid point represents the sound pressure level in decibels of a listener at that position for the highest simulation frequency band of 3400...22050H
  2. Inside distant rooms, doorways act as secondary acoustic sources that provide intermediate goals for the agent to follow.

Let me know if you have other questions.

aluo-x commented 3 years ago

To clarify point 1.

I'm assuming you perform the stft of the impulse response, then do one of the following:

sum across time
    sum across freq[3400, 222050]
        total += stft_magnitude[time, freq]**2.0
vis(total)

Or

total = max(stft[:alltime, 3400:220500]**2.0)
vis(total)

Can you clarify which one it is?

ChanganVR commented 3 years ago

@aluo-x I think he meant the former. And you should also average the power and convert the output to dB.

My collaborator is on vacation right now. I can confirm with him after he comes back.