How to plot a top down map of the room scene about sound-spaces HOT 6 CLOSED

@dosssman I simply checked whether the current audio spectrogram/waveforms are all zeros. This is a bit of an artificial scenario because, in the real world, there is never complete silence. But given the assumption of the task, this worked well.

from sound-spaces.

Hi @dosssman, the first top-down map was created using meshlab by overlaying the acoustic pressure field on top of the mesh file.

And for the second visualization in SAVi, we used another 3D mesh viewer, which I believe is this one: https://gltf-viewer.donmccurdy.com/.

By "how to recover the information" do you mean how did I plot the trajectory with blue and red according to if these steps are sounding? I think I basically color-coded the trajectory according to whether there is sound in this function:

from sound-spaces.

Hello again.

My gratitude for taking the time to check upon this issue.
Duly noted regarding the top down map plotting. I will looking a bit more into the tools you have suggested.

Regarding

[...] how to recover the information about the "Path with sound" and "Path when silent" for the plots, as in the exerpt below:

If my understanding is correct, in SAVI, the sound is only emitted for part of an episode, usually at the beginning, so the agent has to remember it and make association with the category of the object to be able to find it later and solve the task.

I was referring to the ability to plot the path when the sound of the target object is ringing in blue, while the rest of the path that is silent is plotted in red on the top_down_map.

I have actually used the plot_top_down_map, but it does not seem to contain anything related to sound (silent or not).
Will be looking into it a bit more in the meantime, but would definitely appreciate any further insights in case you recall how it was done for the paper.

Thanks a lot for the help.

from sound-spaces.

@dosssman I think I hard-coded that coloring part but that code might not be in the soundspaces repo. Basically, I passed the variable of the length of the sound from the simulator class to the plotting function and the plot the path with sound with one color and the path without sound with another. This should be pretty straightforward.

from sound-spaces.

@ChanganVR Thanks a lot for the answer.

I was wondering about where one should check whether the current time step is silent or not ?
Thanks again for your time.

from sound-spaces.

Thanks a lot for the answer.

from sound-spaces.